00010000:00010000:3.0F:1787834088.216068:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1787834089.238120:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0F:1787834089.825824:0:17121:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1787834089.825875:0:17121:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8df60e181900 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1787834089.825882:0:17121:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df60e1f0200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8df634387240 00000020:00080000:2.0:1787834089.825885:0:17121:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8df60e1f0400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8df6065f0000 00000020:00080000:2.0:1787834089.825916:0:17181:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1787834089.825986:0:17181:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1787834089.826702:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834089.826718:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834089.826726:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834089.826733:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834089.826738:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834089.826746:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834089.833212:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:3.0:1787834089.833216:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834089.833225:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834089.833232:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a400/0x996d2fb20dc1ec07 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787834090.006137:0:17177:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787834090.006147:0:17177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787834090.006167:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787834090.006177:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787834090.269937:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834091.012964:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834091.016145:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382027648 00000100:00100000:0.0:1787834091.016163:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382027648 00000100:00100000:0.0:1787834091.016244:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:0.0:1787834091.016255:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+13:15574:x1874679382027648:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787834091.016361:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+13:15574:x1874679382027648:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 Request processed in 108us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834091.016368:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00080000:2.0:1787834091.016432:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787834091.018094:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834091.018228:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382027776 00000100:00100000:2.0:1787834091.018239:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382027776 00000100:00100000:2.0:1787834091.018955:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:2.0:1787834091.018967:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:15574:x1874679382027776:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787834091.019075:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:15574:x1874679382027776:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 Request processed in 111us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834091.019082:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00080000:3.0:1787834091.026207:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787834091.026341:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834091.026952:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382028032 00000100:00100000:3.0:1787834091.026962:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382028032 00000100:00100000:3.0:1787834091.027043:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1787834091.027052:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+13:15574:x1874679382028032:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787834091.027282:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+14:15574:x1874679382028032:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 230us (945us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787834091.027290:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00010000:00010000:3.0:1787834091.285988:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834091.862062:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406217088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787834091.862137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834091.862319:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406217088 00000100:00100000:3.0:1787834091.862327:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406217088 00000100:00100000:3.0:1787834091.862391:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787834091.862401:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406217088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787834091.862431:0:18652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1787834091.862563:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787834091.862622:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406217088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 222us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834091.862630:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787834091.862716:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406217088:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787834092.310049:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834092.375026:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787834092.375053:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a84fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406217216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787834092.375130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1787834092.375411:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787834092.375439:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406217344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787834092.375474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834092.375522:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406217216 00000100:00100000:1.0:1787834092.375530:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406217216 00000100:00100000:1.0:1787834092.375575:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406217344 00000100:00100000:1.0:1787834092.375578:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406217344 00000100:00100000:1.0:1787834092.375594:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787834092.375603:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406217216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787834092.375633:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787834092.375674:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406217216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834092.375681:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787834092.375698:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787834092.375704:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406217344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787834092.375716:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787834092.375778:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406217344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834092.375783:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787834092.375818:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406217344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787834092.375973:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a84fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406217216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787834092.376103:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787834092.376112:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406217600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787834092.376144:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834092.376178:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406217600 00000100:00100000:3.0:1787834092.376182:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406217600 00000100:00100000:3.0:1787834092.376215:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787834092.376221:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406217600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787834092.376247:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787834092.376283:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406217600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834092.376289:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787834092.376320:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406217600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834092.376498:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406218112:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376528:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376549:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406218624:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376593:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787834092.376598:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406217728:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376644:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406218240:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376692:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406218752:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376740:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406218624 00000100:00100000:2.0:1787834092.376741:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406217856:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376743:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406218624 00000100:00100000:2.0:1787834092.376791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376798:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406218752 00000100:00100000:0.0:1787834092.376801:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406218752 00000100:00100000:2.0:1787834092.376809:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406218368:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376820:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787834092.376826:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406218624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834092.376829:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834092.376838:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406218880:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376865:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406218624:12345-0@lo:400:kworker.0 Request processed in 39us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834092.376869:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376872:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787834092.376882:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787834092.376882:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406218368 00000100:00100000:0.0:1787834092.376884:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406218368 00000100:00100000:2.0:1787834092.376887:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a978780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406217472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834092.376896:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406218880 00000100:00100000:0.0:1787834092.376898:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406218880 00000100:00100000:2.0:1787834092.376907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376911:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787834092.376916:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406218752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834092.376930:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406217984:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376941:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406218752:12345-0@lo:400:kworker.0 Request processed in 25us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.376947:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787834092.376949:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376956:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406217984 00000100:00100000:2.0:1787834092.376958:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406218496:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.376959:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406217984 00000100:00100000:0.0:1787834092.376972:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787834092.376976:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.376977:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406218368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834092.376985:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a84f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406219008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787834092.377018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834092.377018:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406218368:12345-0@lo:400:kworker.0 Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.377032:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787834092.377041:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406218368:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.377043:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406218496 00000100:00100000:0.0:1787834092.377046:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406218496 00000100:00100000:0.0:1787834092.377060:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787834092.377064:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787834092.377065:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406218880:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787834092.377067:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787834092.377070:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787834092.377072:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787834092.377081:0:19578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406218240 00000100:00100000:2.0:1787834092.377084:0:19578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406218240 00000100:00100000:0.0:1787834092.377096:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406218880:12345-0@lo:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.377102:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787834092.377106:0:19578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406217856 00000100:00100000:2.0:1787834092.377108:0:19578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406217856 00000100:00100000:0.0:1787834092.377112:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787834092.377117:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406217984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834092.377127:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787834092.377132:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406218240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.377142:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406217984:12345-0@lo:400:kworker.0 Request processed in 25us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.377148:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787834092.377157:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406218240:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.377158:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787834092.377162:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787834092.377163:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406218496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834092.377171:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787834092.377176:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406217856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.377187:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406218496:12345-0@lo:400:kworker.0 Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.377193:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787834092.377197:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406217856:12345-0@lo:400:kworker.0 Request processed in 21us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834092.377202:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787834092.377214:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406218112 00000100:00100000:0.0:1787834092.377218:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406218112 00000100:00100000:2.0:1787834092.377225:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406217472 00000100:00100000:2.0:1787834092.377227:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406217472 00000100:00100000:0.0:1787834092.377231:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787834092.377236:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874679406218112:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787834092.377247:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787834092.377265:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406219008 00000100:00100000:0.0:1787834092.377266:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874679406218112:12345-0@lo:400:kworker.0 Request processed in 29us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834092.377268:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406219008 00000100:00100000:0.0:1787834092.377272:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787834092.377285:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787834092.377286:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787834092.377291:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406219008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787834092.377291:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406217472:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1787834092.377302:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000004:00000024:0.0:1787834092.377307:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787834092.377330:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406219008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.377330:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406217472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 38us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.377336:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787834092.377337:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787834092.377360:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6212fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406218240:0@lo:400:kworker.0 00000100:00100000:2.0:1787834092.377362:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a978780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406217472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834092.377370:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406217984:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.377370:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5046012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406218752:0@lo:400:kworker.0 00000100:00100000:2.0:1787834092.377377:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504601680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406218496:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.377378:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406218112:0@lo:400:kworker.0 00000100:00100000:2.0:1787834092.377387:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a84f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406219008:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787834092.377388:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df504600b40 x1874679406218624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834092.377394:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406217856:0@lo:400:kworker.0 00000100:00100000:0.0:1787834092.377399:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504600b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406218624:0@lo:400:kworker.0 00010000:00080000:2.0:1787834092.377403:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045aad00 x1874679406218880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834092.377411:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406218880:0@lo:400:kworker.0 00000100:00100000:3.0:1787834092.377560:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406217728 00000100:00100000:3.0:1787834092.377565:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406217728 00000100:00100000:3.0:1787834092.377600:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787834092.377607:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3638:x1874679406217728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834092.377654:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3638:x1874679406217728:12345-0@lo:400:kworker.0 Request processed in 47us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834092.377660:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787834092.377676:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406217728:0@lo:400:kworker.0 00000100:00100000:3.0:1787834092.597104:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834092.597156:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834092.597378:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382028160 00000100:00100000:1.0:1787834092.597390:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382028160 00000100:00100000:1.0:1787834092.597465:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 170 00000100:00100000:1.0:1787834092.597476:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2398:x1874679382028160:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834092.597556:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2398:x1874679382028160:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 82us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834092.597564:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 170 00000100:00100000:0.0:1787834092.598373:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382028288 00000100:00100000:0.0:1787834092.598381:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382028288 00000100:00100000:0.0:1787834092.598435:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:0.0:1787834092.598444:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+14:2398:x1874679382028288:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834092.598521:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+14:2398:x1874679382028288:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 78us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.598527:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:3.0:1787834092.611927:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834092.612059:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382028416 00000100:00100000:0.0:1787834092.612069:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382028416 00000100:00100000:0.0:1787834092.612189:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:0.0:1787834092.612200:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2399:x1874679382028416:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834092.612301:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2399:x1874679382028416:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 103us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834092.612322:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:3.0:1787834092.617606:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834092.618167:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834092.618329:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834092.618364:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834092.618380:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834092.618399:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834092.618447:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382028800 00000100:00100000:3.0:1787834092.618455:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382028800 00000100:00100000:3.0:1787834092.618510:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382028928 00000100:00100000:3.0:1787834092.618513:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382028928 00000100:00100000:3.0:1787834092.618532:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:3.0:1787834092.618541:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2398:x1874679382028800:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834092.618614:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2398:x1874679382028800:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 73us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834092.619100:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382028672 00000100:00100000:2.0:1787834092.619108:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382028672 00000100:00100000:2.0:1787834092.619147:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382028544 00000100:00100000:2.0:1787834092.619151:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382028544 00000100:00100000:2.0:1787834092.619167:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382029056 00000100:00100000:2.0:1787834092.619169:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382029056 00000100:00100000:2.0:1787834092.619180:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382029184 00000100:00100000:2.0:1787834092.619196:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382029184 00000100:00100000:2.0:1787834092.619214:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1787834092.619222:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382028672:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834092.619275:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382028672:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 53us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834092.619282:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1787834092.619300:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:2.0:1787834092.619305:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2397:x1874679382028544:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:2.0:1787834092.619322:0:18648:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e936 00000100:00080000:2.0:1787834092.619338:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8df50441b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787834092.619381:0:18648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787834092.619421:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:3.0:1787834092.619446:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:3.0:1787834092.619455:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382028928:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834092.619495:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382028928:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 42us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834092.619502:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 85 00010000:00010000:3.0:1787834092.619526:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834092.619534:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+2:2397:x1874679382028544:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 226us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834092.619543:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:2.0:1787834092.619559:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1787834092.619567:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2397:x1874679382029056:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:2.0:1787834092.619582:0:18648:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e975 00000100:00080000:2.0:1787834092.619588:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8df5039ec800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787834092.619613:0:18648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787834092.619666:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+2:2397:x1874679382029056:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 100us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834092.619673:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1787834092.619687:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:2.0:1787834092.619693:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2397:x1874679382029184:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:2.0:1787834092.619704:0:18648:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e97c 00000100:00080000:2.0:1787834092.619715:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8df502ccf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787834092.619739:0:18648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787834092.619825:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+2:2397:x1874679382029184:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 131us (1424us total) trans 0 rc 0/0 00000100:00080000:1.0:1787834092.619831:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787834092.619832:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00080000:1.0:1787834092.619849:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787834092.619854:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787834092.619857:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787834092.619859:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834092.619888:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834093.334013:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787834093.526495:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787834094.358068:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787834095.340823:0:20519:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 08:34:54 (1787834094) 00010000:00010000:1.0:1787834095.383145:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787834095.962385:0:17121:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787834095.962400:0:17121:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1787834095.962417:0:17181:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1787834095.962428:0:17181:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1787834096.406859:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834096.987509:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787834096.987543:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406219136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787834096.987627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834096.987697:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406219136 00000100:00100000:3.0:1787834096.987705:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406219136 00000100:00100000:3.0:1787834096.987777:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787834096.987785:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406219136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787834096.987815:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787834096.987858:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406219136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834096.987866:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787834096.987886:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787834096.987934:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406219136:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787834097.429906:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834097.494144:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406219392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787834097.494222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834097.494318:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406219392 00000100:00100000:1.0:1787834097.494326:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406219392 00000100:00100000:1.0:1787834097.494378:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787834097.494387:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406219392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787834097.494410:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787834097.494455:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406219392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.494462:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787834097.494482:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787834097.494519:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406219392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787834097.494556:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406219264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787834097.494581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834097.494608:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406219264 00000100:00100000:1.0:1787834097.494612:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406219264 00000100:00100000:1.0:1787834097.494637:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787834097.494644:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406219264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787834097.494664:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787834097.494696:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406219264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.494710:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787834097.494726:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787834097.494745:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406219264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787834097.496050:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406219648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834097.496109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834097.496161:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406219648 00000100:00100000:0.0:1787834097.496168:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406219648 00000100:00100000:0.0:1787834097.496214:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787834097.496223:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406219648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787834097.496520:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787834097.496565:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406219648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 344us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834097.496572:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787834097.496597:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406219520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834097.496623:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834097.496658:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406220032:0@lo:400:kworker.0 00000100:00100000:0.0:1787834097.496683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834097.496704:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406220544:0@lo:400:kworker.0 00000100:00100000:0.0:1787834097.496726:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834097.496746:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787834097.496772:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406219904:0@lo:400:kworker.0 00000100:00100000:0.0:1787834097.496793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834097.496905:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406219520 00000100:00100000:2.0:1787834097.496911:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406219520 00000100:00100000:2.0:1787834097.496933:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406219904 00000100:00100000:2.0:1787834097.496936:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406219904 00000100:00100000:2.0:1787834097.496947:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787834097.496953:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406219520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787834097.496981:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834097.497013:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406219520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834097.497020:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787834097.497032:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787834097.497039:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406219904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834097.497068:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406219904:12345-0@lo:400:kworker.0 Request processed in 30us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834097.497075:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787834097.497136:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406219904:0@lo:400:kworker.0 00000100:00100000:0.0:1787834097.497143:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406220416:0@lo:400:kworker.0 00000100:00100000:0.0:1787834097.497184:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834097.497921:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406220928:0@lo:400:kworker.0 00000100:00100000:0.0:1787834097.497951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834097.499412:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406219776:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.499474:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834097.499511:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406220288:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.499539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834097.499561:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406220800:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.499597:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406220288 00000100:00100000:1.0:1787834097.499603:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406220288 00000100:00100000:1.0:1787834097.499663:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787834097.499672:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406220288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.499724:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406220288:12345-0@lo:400:kworker.0 Request processed in 53us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.499732:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787834097.499773:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787834097.499787:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406220160:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.499820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834097.499837:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406220672:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.499865:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406220160 00000100:00100000:1.0:1787834097.499868:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406220160 00000100:00100000:1.0:1787834097.499892:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787834097.499897:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406220160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.499927:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406220160:12345-0@lo:400:kworker.0 Request processed in 30us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.499944:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787834097.499978:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787834097.499988:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406221056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787834097.500013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834097.500036:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406221056 00000100:00100000:1.0:1787834097.500039:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406221056 00000100:00100000:1.0:1787834097.500059:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787834097.500065:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406221056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787834097.500091:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787834097.500126:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406221056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.500132:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787834097.500174:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406221056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787834097.505448:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406219520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834097.505495:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406219776 00000100:00100000:0.0:1787834097.505501:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406219776 00000100:00100000:0.0:1787834097.505554:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787834097.505564:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3639:x1874679406219776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834097.505629:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3639:x1874679406219776:12345-0@lo:400:kworker.0 Request processed in 66us (6155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834097.505636:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787834097.507390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834097.510380:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406220032 00000100:00100000:2.0:1787834097.510399:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406220032 00000100:00100000:0.0:1787834097.515129:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406220544 00000100:00100000:0.0:1787834097.515143:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406220544 00000100:00100000:0.0:1787834097.517195:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406220416 00000100:00100000:0.0:1787834097.517208:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406220416 00000100:00100000:0.0:1787834097.517238:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406220928 00000100:00100000:0.0:1787834097.517241:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406220928 00000100:00100000:1.0:1787834097.517313:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787834097.517328:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406220544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.517432:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406220544:12345-0@lo:400:kworker.0 Request processed in 108us (20704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.517439:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787834097.517457:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787834097.517463:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406220416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.517489:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406220416:12345-0@lo:400:kworker.0 Request processed in 26us (20305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.517495:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787834097.519419:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406220416:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.519451:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406220544:0@lo:400:kworker.0 00000100:00080000:2.0:1787834097.522658:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787834097.522671:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787834097.527635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834097.532730:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406220672 00000100:00100000:2.0:1787834097.532761:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406220672 00000100:00100000:2.0:1787834097.533000:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787834097.533012:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406220672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834097.533108:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406220672:12345-0@lo:400:kworker.0 Request processed in 99us (25723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834097.533115:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787834097.533224:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787834097.533770:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787834097.533781:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6012e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406220032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.533845:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6012e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406220032:12345-0@lo:400:kworker.0 Request processed in 67us (37161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.533852:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787834097.533897:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406220032:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.533948:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787834097.533955:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504601680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406220928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.534018:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504601680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406220928:12345-0@lo:400:kworker.0 Request processed in 64us (36066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.534024:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1787834097.534076:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63c6a8780 x1874679406220672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787834097.534087:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63c6a8f00 x1874679406220928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834097.534093:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406220672:0@lo:400:kworker.0 00000100:00100000:0.0:1787834097.534107:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406220928:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.534124:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406219648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787834097.534152:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406220160:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.540920:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406220800 00000100:00100000:1.0:1787834097.540934:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406220800 00000100:00100000:1.0:1787834097.541016:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787834097.541023:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787834097.541028:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406220800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834097.541909:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3639:1874679406219776:0@lo:400:kworker.0 00000100:00100000:3.0:1787834097.541934:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406220288:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.545411:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406220800:12345-0@lo:400:kworker.0 Request processed in 4378us (17774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.545441:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787834097.555153:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406220800:0@lo:400:kworker.0 00000100:00100000:1.0:1787834097.724548:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834097.724585:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834097.724603:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834097.724619:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834097.724639:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834097.724660:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834097.724683:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382029568 00000100:00100000:1.0:1787834097.724691:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382029568 00000100:00100000:1.0:1787834097.724737:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382029824 00000100:00100000:1.0:1787834097.724740:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382029824 00000100:00100000:1.0:1787834097.724773:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382029440 00000100:00100000:1.0:1787834097.724776:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382029440 00000100:00100000:1.0:1787834097.724787:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382029952 00000100:00100000:1.0:1787834097.724789:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382029952 00000100:00100000:1.0:1787834097.724803:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:1.0:1787834097.724810:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382029568:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834097.724870:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382029568:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 60us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.724877:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:1.0:1787834097.724893:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:1.0:1787834097.724899:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2398:x1874679382029824:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834097.724919:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2398:x1874679382029824:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 21us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.724925:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:1.0:1787834097.724935:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:1.0:1787834097.724941:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+13:2398:x1874679382029440:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834097.725097:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382029312 00000100:00100000:3.0:1787834097.725101:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382029312 00000100:00100000:3.0:1787834097.725129:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 172 00000100:00100000:3.0:1787834097.725136:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2398:x1874679382029312:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834097.725164:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2398:x1874679382029312:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 29us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834097.725170:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 172 00000100:00100000:2.0:1787834097.725362:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00100000:2.0:1787834097.725372:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382029952:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834097.725405:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2398:x1874679382029952:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 36us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834097.725412:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00100000:1.0:1787834097.725701:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+13:2398:x1874679382029440:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 758us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.725709:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:1.0:1787834097.725729:0:19578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382029696 00000100:00100000:1.0:1787834097.725733:0:19578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382029696 00000100:00100000:1.0:1787834097.725820:0:19578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:1.0:1787834097.725826:0:19578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382029696:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834097.725851:0:19578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ff1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2398:x1874679382029696:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834097.725857:0:19578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00080000:0.0:1787834097.727002:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787834097.727009:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787834097.727012:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1787834098.009245:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000020:00000080:1.0:1787834098.009258:0:19463:0:(genops.c:885:class_export_put()) final put ffff8df5039e9800/3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000020:00000080:2.0:1787834098.009659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039e9800/3b7b3847-f4f2-42ea-93f4-1f34e9067bef for lustre-OST0001 00000020:00000080:2.0:1787834098.009720:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502ccf800 for lustre-OST0001 00000001:00100000:0.0:1787834098.009861:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000020:00000080:0.0:1787834098.009866:0:18644:0:(genops.c:885:class_export_put()) final put ffff8df5039ef800/3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000001:00100000:0.0:1787834098.009888:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4903173d-3c15-42de-bfe8-e4a9090d66c7 00000020:00000080:0.0:1787834098.009905:0:18644:0:(genops.c:885:class_export_put()) final put ffff8df50441d800/4903173d-3c15-42de-bfe8-e4a9090d66c7 00000020:00000080:3.0:1787834098.009964:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039ef800/3b7b3847-f4f2-42ea-93f4-1f34e9067bef for lustre-OST0000 00000020:00000080:3.0:1787834098.009999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df50441d800/4903173d-3c15-42de-bfe8-e4a9090d66c7 for lustre-OST0000 00000020:00000080:3.0:1787834098.010022:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5039ec800 for lustre-OST0000 00000020:00000080:3.0:1787834098.010025:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df50441b800 for lustre-OST0000 00010000:00010000:1.0:1787834098.458371:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834099.486999:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834099.523651:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834099.523740:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382030208 00000100:00100000:2.0:1787834099.523780:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382030208 00000100:00100000:2.0:1787834099.523864:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:2.0:1787834099.523875:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504600b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+13:16334:x1874679382030208:12345-192.168.203.17@tcp:35:umount.0 00000001:00080000:2.0:1787834099.524117:0:17145:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787834099.524204:0:17145:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1787834099.524823:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504600b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4903173d-3c15-42de-bfe8-e4a9090d66c7+16:16334:x1874679382030208:12345-192.168.203.17@tcp:35:umount.0 Request processed in 947us (1179us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1787834099.524832:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000020:00080000:2.0:1787834099.524839:0:17145:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:0.0:1787834099.525150:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787834099.533333:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834099.533367:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834099.533392:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834099.533473:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834099.533544:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382030336 00000100:00100000:1.0:1787834099.533553:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382030336 00000100:00100000:1.0:1787834099.533607:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382030592 00000100:00100000:1.0:1787834099.533617:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382030592 00000100:00100000:1.0:1787834099.533632:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382030464 00000100:00100000:1.0:1787834099.533634:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382030464 00000100:00100000:1.0:1787834099.533649:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:1.0:1787834099.533660:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c8abb39-d835-4001-b54a-d8ba07846eed+15:2398:x1874679382030336:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834099.533675:0:18674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834099.533695:0:18674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4ee00/0x996d2fb20dc1e913 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef3c expref: 15 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834099.533712:0:18674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834099.533795:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c8abb39-d835-4001-b54a-d8ba07846eed+14:2398:x1874679382030336:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 137us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834099.533817:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:1.0:1787834099.533836:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:1.0:1787834099.533842:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c8abb39-d835-4001-b54a-d8ba07846eed+13:2398:x1874679382030592:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834099.533850:0:18674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834099.533859:0:18674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1e9d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f023 expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834099.533868:0:18674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834099.533888:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c8abb39-d835-4001-b54a-d8ba07846eed+12:2398:x1874679382030592:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 46us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834099.533894:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:1.0:1787834099.533906:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:1.0:1787834099.533911:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635d74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c8abb39-d835-4001-b54a-d8ba07846eed+11:2398:x1874679382030464:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834099.533918:0:18674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834099.533927:0:18674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1e91a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef6d expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834099.533935:0:18674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834099.533963:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635d74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c8abb39-d835-4001-b54a-d8ba07846eed+10:2398:x1874679382030464:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 52us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834099.533969:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:1.0:1787834099.534025:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382030720 00000100:00100000:1.0:1787834099.534030:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382030720 00000100:00100000:1.0:1787834099.534066:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:1.0:1787834099.534073:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2397:x1874679382030720:12345-192.168.203.17@tcp:9:umount.0 00000020:00000080:1.0:1787834099.534111:0:18650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e93d 00000100:00080000:1.0:1787834099.534120:0:18650:0:(import.c:65:import_set_state_nolock()) ffff8df50441f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787834099.534160:0:18650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787834099.534273:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+2:2397:x1874679382030720:12345-192.168.203.17@tcp:9:umount.0 Request processed in 199us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834099.534280:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 29 00010000:00010000:1.0:1787834099.534299:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787834099.534449:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787834099.550347:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834099.550803:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382031616 00000100:00100000:2.0:1787834099.550813:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382031616 00000100:00100000:2.0:1787834099.550874:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:2.0:1787834099.550885:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+16:2397:x1874679382031616:12345-192.168.203.17@tcp:39:umount.0 00000020:00000080:2.0:1787834099.550919:0:17141:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e928 00000020:00010000:2.0:1787834099.550936:0:17141:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df50474e000: total 0 00000100:00080000:2.0:1787834099.550941:0:17141:0:(import.c:65:import_set_state_nolock()) ffff8df60665e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787834099.550982:0:17141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1787834099.551139:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4903173d-3c15-42de-bfe8-e4a9090d66c7+15:2397:x1874679382031616:12345-192.168.203.17@tcp:39:umount.0 Request processed in 256us (801us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1787834099.551147:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000020:00010000:0.0:1787834099.551386:0:17129:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df50474e000: total 0 00010000:00010000:0.0:1787834099.551391:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834099.551440:0:17129:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df50474e000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787834099.551471:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df503f0c900) 00010000:00010000:0.0:1787834099.551474:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787834099.551481:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3a200/0x996d2fb20dc1e9f3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f02a expref: 14 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834099.551501:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8df502e11400) 00010000:00010000:0.0:1787834099.551503:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787834099.551519:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677200/0x996d2fb20dc1ead3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f069 expref: 13 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834099.551536:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:0.0:1787834099.551538:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787834099.551541:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504677400/0x996d2fb20dc1eb82 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0a8 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834099.551551:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:0.0:1787834099.551553:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787834099.551556:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1ec38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0d9 expref: 11 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834099.551567:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8df6068e6200) 00010000:00010000:0.0:1787834099.551569:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787834099.551586:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3bc00/0x996d2fb20dc1eb51 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f093 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834099.551601:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df502e11800) 00010000:00010000:0.0:1787834099.551603:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787834099.551606:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df5044b7000/0x996d2fb20dc1ea0f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f031 expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834099.551630:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:0.0:1787834099.551632:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787834099.551635:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f000/0x996d2fb20dc1ea4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f03f expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834099.551645:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8df62ea54000) 00010000:00010000:0.0:1787834099.551646:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787834099.551649:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df504676c00/0x996d2fb20dc1ebdd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0bd expref: 7 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834099.551662:0:17129:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df50474e000, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1787834099.551674:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834099.551676:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834099.551678:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834099.558570:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834099.558667:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382031744 00000100:00100000:1.0:1787834099.558677:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382031744 00000100:00080000:0.0:1787834099.558727:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787834099.558790:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:1.0:1787834099.558803:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5046012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+5:2397:x1874679382031744:12345-192.168.203.17@tcp:39:umount.0 00000020:00000080:1.0:1787834099.558838:0:17143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e92f 00000100:00080000:1.0:1787834099.558857:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8df503f66000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787834099.558887:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787834099.558920:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834099.559159:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5046012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4903173d-3c15-42de-bfe8-e4a9090d66c7+3:2397:x1874679382031744:12345-192.168.203.17@tcp:39:umount.0 Request processed in 358us (596us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787834099.559169:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00000040:00080000:3.0:1787834100.247636:0:17177:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787834100.247646:0:17177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787834100.247666:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787834100.247674:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787834100.507981:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834101.523138:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834101.523180:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834101.523213:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834101.523303:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382031872 00000100:00100000:0.0:1787834101.523313:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382031872 00000100:00100000:0.0:1787834101.523377:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382032128 00000100:00100000:0.0:1787834101.523380:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382032128 00000100:00100000:0.0:1787834101.523392:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382032000 00000100:00100000:0.0:1787834101.523395:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382032000 00000100:00100000:0.0:1787834101.523439:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:0.0:1787834101.523449:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6abc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8abb39-d835-4001-b54a-d8ba07846eed+12:2401:x1874679382031872:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834101.523465:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834101.523484:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1e952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efac expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834101.523501:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834101.523552:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6abc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8abb39-d835-4001-b54a-d8ba07846eed+11:2401:x1874679382031872:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 104us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834101.523559:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:0.0:1787834101.523574:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1787834101.523580:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8abb39-d835-4001-b54a-d8ba07846eed+10:2401:x1874679382032128:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834101.523587:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834101.523597:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b200/0x996d2fb20dc1e9d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f01c expref: 10 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834101.523606:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834101.523638:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8abb39-d835-4001-b54a-d8ba07846eed+9:2401:x1874679382032128:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 58us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834101.523644:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1787834101.523656:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1787834101.523661:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8abb39-d835-4001-b54a-d8ba07846eed+8:2401:x1874679382032000:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834101.523678:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834101.523687:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3a000/0x996d2fb20dc1e959 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91efdd expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834101.523707:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834101.523731:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8abb39-d835-4001-b54a-d8ba07846eed+7:2401:x1874679382032000:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 70us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834101.523737:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00010000:00010000:0.0:1787834101.525992:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834101.532702:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834101.533100:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382032384 00000100:00100000:2.0:1787834101.533110:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382032384 00000100:00100000:2.0:1787834101.533185:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:2.0:1787834101.533196:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+6:2397:x1874679382032384:12345-192.168.203.17@tcp:39:umount.0 00000100:00080000:0.0:1787834101.533482:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787834101.533511:0:17141:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e967 00000020:00010000:2.0:1787834101.533519:0:17141:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df50441b000: total 0 00000100:00080000:2.0:1787834101.533525:0:17141:0:(import.c:65:import_set_state_nolock()) ffff8df504418000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787834101.533551:0:17141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:3.0:1787834101.533957:0:19480:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df50441b000: total 0 00010000:00010000:3.0:1787834101.534006:0:19480:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df50441b000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787834101.534038:0:19480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df6068e6d00) 00010000:00010000:3.0:1787834101.534041:0:19480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787834101.534050:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df503c3b600/0x996d2fb20dc1ea5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f046 expref: 5 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834101.534073:0:19480:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df50441b000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787834101.534096:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834101.534098:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834101.534100:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834101.534177:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+3:2397:x1874679382032384:12345-192.168.203.17@tcp:39:umount.0 Request processed in 982us (1483us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787834101.534194:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:0.0:1787834101.542595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834101.542881:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382032512 00000100:00100000:1.0:1787834101.542892:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382032512 00000100:00100000:1.0:1787834101.542970:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:1.0:1787834101.542981:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+5:2397:x1874679382032512:12345-192.168.203.17@tcp:39:umount.0 00000020:00000080:1.0:1787834101.543018:0:17143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e96e 00000100:00080000:1.0:1787834101.543027:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8df5039ee000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787834101.543058:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1787834101.543190:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b7b3847-f4f2-42ea-93f4-1f34e9067bef+3:2397:x1874679382032512:12345-192.168.203.17@tcp:39:umount.0 Request processed in 211us (604us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787834101.543210:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00080000:0.0:1787834101.543728:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787834101.543802:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834101.564606:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834101.565149:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382032768 00000100:00100000:1.0:1787834101.565161:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382032768 00000100:00100000:1.0:1787834101.565325:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 173 00000100:00100000:1.0:1787834101.565337:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+7:2397:x1874679382032768:12345-192.168.203.17@tcp:251:umount.0 00000020:00000080:1.0:1787834101.565382:0:17135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e905 00000020:00010000:1.0:1787834101.565390:0:17135:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df603459000: total 0 00000100:00080000:1.0:1787834101.565394:0:17135:0:(import.c:65:import_set_state_nolock()) ffff8df60345b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787834101.565480:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8abb39-d835-4001-b54a-d8ba07846eed+3:2397:x1874679382032768:12345-192.168.203.17@tcp:251:umount.0 Request processed in 145us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834101.565488:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 173 00000020:00010000:0.0:1787834101.567966:0:17129:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df603459000: total 0 00010000:00010000:0.0:1787834101.568038:0:17129:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df603459000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787834101.568077:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504677600/0x996d2fb20dc1e90c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91ef35 expref: 2 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834101.568095:0:17129:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df603459000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787834101.568106:0:17129:0:(genops.c:885:class_export_put()) final put ffff8df603459000/7c8abb39-d835-4001-b54a-d8ba07846eed 00010000:00010000:0.0:1787834101.568133:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834101.568135:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834101.568137:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787834101.571545:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df603459000/7c8abb39-d835-4001-b54a-d8ba07846eed for MGS 00000020:00000080:2.0:1787834101.571621:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df60345b800 for MGS 00000100:00100000:3.0:1787834102.102213:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406221184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787834102.102308:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834102.102967:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406221184 00000100:00100000:0.0:1787834102.103099:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406221184 00000100:00100000:0.0:1787834102.103201:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787834102.103213:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406221184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787834102.103254:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787834102.103306:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406221184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834102.103313:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787834102.103373:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406221184:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787834102.103579:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787834102.549905:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834102.620641:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406221312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834102.620714:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834102.621113:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406221440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787834102.621147:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834102.621175:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787834102.621181:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406221568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787834102.621203:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834102.621246:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406221440 00000100:00100000:1.0:1787834102.621253:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406221440 00000100:00100000:1.0:1787834102.621294:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406221568 00000100:00100000:1.0:1787834102.621297:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406221568 00000100:00100000:1.0:1787834102.621313:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787834102.621320:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406221440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787834102.621347:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787834102.621388:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406221440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834102.621407:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787834102.621423:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787834102.621430:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406221568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787834102.621440:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787834102.621465:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406221568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834102.621471:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787834102.621490:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787834102.621535:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406221568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787834102.621548:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406221440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787834102.621800:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787834102.621809:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e122580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406221696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787834102.621838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834102.622016:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406221696 00000100:00100000:1.0:1787834102.622021:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406221696 00000100:00100000:1.0:1787834102.622062:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787834102.622068:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e121680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406221696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787834102.622080:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787834102.622114:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e121680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406221696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834102.622120:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787834102.622153:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e122580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406221696:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787834102.622197:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787834102.625634:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406221312 00000100:00100000:2.0:1787834102.625648:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406221312 00000100:00100000:2.0:1787834102.625709:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787834102.625719:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406221312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787834102.625778:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787834102.625862:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406221312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (5148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834102.625869:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787834102.625937:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406221312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834102.626670:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406221824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834102.626716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834102.631646:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406221824 00000100:00100000:3.0:1787834102.631661:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406221824 00000100:00100000:3.0:1787834102.631709:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787834102.631719:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406221824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787834102.631787:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834102.634115:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fb94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406221952:0@lo:400:kworker.0 00000100:00100000:0.0:1787834102.634389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834102.634436:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406222464:0@lo:400:kworker.0 00000100:00100000:0.0:1787834102.634463:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834102.634487:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787834102.634565:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406222080:0@lo:400:kworker.0 00000100:00100000:0.0:1787834102.634592:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834102.634610:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406222592:0@lo:400:kworker.0 00000100:00100000:0.0:1787834102.634630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834102.635351:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406221824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3629us (8629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834102.635364:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787834102.635424:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406222464 00000100:00100000:3.0:1787834102.635431:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406222464 00000100:00100000:3.0:1787834102.635480:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406222080 00000100:00100000:3.0:1787834102.635483:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406222080 00000100:00100000:3.0:1787834102.635577:0:18167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406222592 00000100:00100000:3.0:1787834102.635582:0:18167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406222592 00000100:00100000:3.0:1787834102.635603:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787834102.635611:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df621338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406222464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834102.635684:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df621338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406222464:12345-0@lo:400:kworker.0 Request processed in 73us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834102.635691:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787834102.635705:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787834102.635711:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62133a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406222080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834102.635742:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62133a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406222080:12345-0@lo:400:kworker.0 Request processed in 31us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834102.635843:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787834102.635971:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406221952 00000100:00100000:1.0:1787834102.635976:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406221952 00000100:00100000:1.0:1787834102.636008:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787834102.636016:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3640:x1874679406221952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834102.636052:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3640:x1874679406221952:12345-0@lo:400:kworker.0 Request processed in 37us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834102.636066:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787834102.636114:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787834102.636123:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6212912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406222592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834102.636157:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6212912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406222592:12345-0@lo:400:kworker.0 Request processed in 36us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834102.636243:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406221824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834102.636270:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406222336:0@lo:400:kworker.0 00000100:00100000:2.0:1787834102.636302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834102.636319:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787834102.636325:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406222208:0@lo:400:kworker.0 00000100:00100000:2.0:1787834102.636345:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834102.636357:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406222720:0@lo:400:kworker.0 00000100:00100000:2.0:1787834102.636376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834102.636413:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406222336 00000100:00100000:2.0:1787834102.636417:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406222336 00000100:00100000:1.0:1787834102.639136:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406222208 00000100:00100000:1.0:1787834102.639151:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406222208 00000100:00100000:1.0:1787834102.639188:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406222720 00000100:00100000:1.0:1787834102.639191:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406222720 00000100:00100000:1.0:1787834102.639214:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787834102.639223:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406222208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834102.639631:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787834102.639659:0:18167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787834102.639668:0:18167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406222720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834102.639854:0:18167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874679406222720:12345-0@lo:400:kworker.0 Request processed in 188us (3475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834102.639934:0:18167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787834102.639985:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406222080:0@lo:400:kworker.0 00000100:00100000:3.0:1787834102.639998:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406222592:0@lo:400:kworker.0 00000100:00100000:3.0:1787834102.640009:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fb94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406221952:0@lo:400:kworker.0 00010000:00080000:3.0:1787834102.640022:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045712c0 x1874679406222464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834102.640049:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406222464:0@lo:400:kworker.0 00000100:00080000:3.0:1787834102.640079:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787834102.640084:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787834102.640175:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406222208:12345-0@lo:400:kworker.0 Request processed in 953us (3828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834102.640181:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787834102.640334:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406222208:0@lo:400:kworker.0 00010000:00080000:0.0:1787834102.640345:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5045721c0 x1874679406222720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834102.640353:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406222720:0@lo:400:kworker.0 00000100:00100000:2.0:1787834102.640435:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787834102.640446:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406222336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834102.640591:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406222336:12345-0@lo:400:kworker.0 Request processed in 149us (4288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834102.640598:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787834102.641413:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504571680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406222336:0@lo:400:kworker.0 00000020:01000004:0.0:1787834103.402287:0:20714:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787834103.412942:0:20714:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787834103.412994:0:20714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.413008:0:20714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.413016:0:20714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.413037:0:20714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.416247:0:20714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787834103.416261:0:20714:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787834103.416299:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787834103.416303:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787834103.416308:0:20714:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787834103.416331:0:20714:0:(import.c:65:import_set_state_nolock()) ffff8df502521800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787834103.417834:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406222848:0@lo:39:umount.0 00000100:00100000:3.0:1787834103.417910:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834103.417978:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406222848 00000100:00100000:3.0:1787834103.417987:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406222848 00000100:00100000:3.0:1787834103.418035:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787834103.418045:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874679406222848:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787834103.418073:0:17143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e4f9 00000100:00080000:3.0:1787834103.418081:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8df6063ca800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787834103.418318:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834103.418327:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.418337:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722e00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834103.418341:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.418351:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834103.418359:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834103.418366:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787834103.418368:0:17130:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787834103.418371:0:17130:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787834103.418403:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.418411:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787834103.418431:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.418439:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df620722e00/0x996d2fb20dc1e4c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e4cf expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.418460:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834103.418462:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834103.418464:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834103.421415:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787834103.421447:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406222976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787834103.421649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834103.421722:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406222976 00000100:00100000:1.0:1787834103.421730:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406222976 00000100:00100000:1.0:1787834103.421892:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787834103.421901:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+24:3638:x1874679406222976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834103.421926:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834103.421945:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600030200/0x996d2fb20dc1e4cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e4c8 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.421961:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834103.421999:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:3638:x1874679406222976:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834103.422007:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787834103.422050:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406222976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834103.425336:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834103.425595:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1874679406222848:12345-0@lo:39:umount.0 Request processed in 7545us (7678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834103.425607:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1787834103.425622:0:17143:0:(genops.c:885:class_export_put()) final put ffff8df62ea7b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787834103.425687:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62ea7b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787834103.425875:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df6063ca800 for lustre-MDT0000 00000100:00080000:0.0:1787834103.426035:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502521800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787834103.426057:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406222848:0@lo:39:umount.0 00000100:00080000:1.0:1787834103.426117:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787834103.426135:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787834103.426140:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787834103.427560:0:20714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.427579:0:20714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.427586:0:20714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.427594:0:20714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.427665:0:20714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834103.427673:0:20714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.427681:0:20714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.427688:0:20714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.427694:0:20714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.428047:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787834103.428054:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.428062:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834103.428066:0:19480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.428075:0:19480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834103.428083:0:19480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834103.428090:0:19480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787834103.428104:0:19480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787834103.428140:0:19480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.428147:0:19480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787834103.428203:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df621292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406223104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834103.428278:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834103.428361:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406223104 00000100:00100000:2.0:1787834103.428369:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406223104 00000100:00100000:2.0:1787834103.428418:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787834103.428426:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e1230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:3640:x1874679406223104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834103.428438:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834103.428451:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600030600/0x996d2fb20dc1e420 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e419 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.428467:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787834103.428585:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.428595:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df620723000/0x996d2fb20dc1e419 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e420 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.428607:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834103.428610:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.428616:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834103.428619:0:19480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.428625:0:19480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834103.428631:0:19480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834103.428636:0:19480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787834103.428638:0:19480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1787834103.428653:0:19480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.428658:0:19480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787834103.428888:0:20714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1787834103.428895:0:20714:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787834103.428904:0:20714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.428928:0:20714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.428934:0:20714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.428940:0:20714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.428954:0:20714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834103.428959:0:20714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.428966:0:20714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.428972:0:20714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.428978:0:20714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834103.428986:0:20714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787834103.428989:0:20714:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787834103.428993:0:20714:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787834103.429027:0:20714:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787834103.429032:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787834103.429037:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787834103.429042:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1787834103.429053:0:20714:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df502ccc800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787834103.429059:0:20714:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df503f62800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787834103.429063:0:20714:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df60652d000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787834103.429067:0:20714:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8df602e45800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787834103.429074:0:20714:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8df50441b000 3b7b3847-f4f2-42ea-93f4-1f34e9067bef 192.168.203.17@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1787834103.429078:0:20714:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8df50474e000 4903173d-3c15-42de-bfe8-e4a9090d66c7 192.168.203.17@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1787834103.429082:0:20714:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8df503f13490) has exports, disconnecting them 00000020:00080000:1.0:1787834103.429086:0:20714:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df502ccc800), last request at 1787834102 00000020:00000080:1.0:1787834103.429093:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e730 00000100:00080000:1.0:1787834103.429110:0:20714:0:(import.c:65:import_set_state_nolock()) ffff8df502cce800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787834103.429156:0:20714:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df502ccc800): rc 0 00000020:00000080:1.0:1787834103.429159:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df502ccc800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787834103.429169:0:20714:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df503f62800), last request at 1787834102 00000020:00000080:1.0:1787834103.429173:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e696 00000100:00080000:1.0:1787834103.429178:0:20714:0:(import.c:65:import_set_state_nolock()) ffff8df503f61800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787834103.429188:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502ccc800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787834103.429246:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502cce800 for lustre-MDT0000 00000020:00080000:1.0:1787834103.429260:0:20714:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df503f62800): rc 0 00000020:00000080:1.0:1787834103.429262:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df503f62800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787834103.429269:0:20714:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df60652d000), last request at 1787834031 00000020:00000080:1.0:1787834103.429272:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e5e7 00000100:00080000:1.0:1787834103.429275:0:20714:0:(import.c:65:import_set_state_nolock()) ffff8df606528800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787834103.429283:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f62800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787834103.429303:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df503f61800 for lustre-MDT0000 00000020:00080000:1.0:1787834103.429313:0:20714:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df60652d000): rc 0 00000020:00000080:1.0:1787834103.429321:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df60652d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787834103.429330:0:20714:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8df602e45800), last request at 1787834030 00000020:00000080:1.0:1787834103.429334:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e58c 00000100:00080000:1.0:1787834103.429338:0:20714:0:(import.c:65:import_set_state_nolock()) ffff8df6065e5800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787834103.429346:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60652d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787834103.429368:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df606528800 for lustre-MDT0000 00000001:00000004:1.0:1787834103.429377:0:20714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:1.0:1787834103.429449:0:20714:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df602e45800): rc 0 00000004:00000080:1.0:1787834103.429456:0:20714:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9fc9c8573ae0 00000100:00080000:1.0:1787834103.429475:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787834103.429715:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787834103.430653:0:20714:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787834103.430680:0:20714:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787834103.430846:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787834103.430849:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1787834103.430862:0:20714:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787834103.430914:0:20714:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787834103.430935:0:20714:0:(import.c:65:import_set_state_nolock()) ffff8df50454a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787834103.430941:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787834103.430943:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1787834103.430951:0:20714:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787834103.431014:0:20714:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787834103.431023:0:20714:0:(import.c:65:import_set_state_nolock()) ffff8df63fb42000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787834103.431061:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8df503f13490) has no exports 00000100:00100000:2.0:1787834103.431242:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e1230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:3640:x1874679406223104:12345-0@lo:103:ldlm_bl.0 Request processed in 2813us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834103.431255:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787834103.431333:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834103.431340:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431350:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834103.431354:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431363:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834103.431387:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834103.431393:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787834103.431396:0:17130:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787834103.431399:0:17130:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787834103.431424:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431430:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787834103.431447:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431455:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b6800/0x996d2fb20dc1e9c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e9c9 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431466:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834103.431469:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431475:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834103.431477:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431596:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834103.431603:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834103.431617:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787834103.431620:0:17130:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787834103.431622:0:17130:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787834103.431637:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431643:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787834103.431649:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431654:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df620722a00/0x996d2fb20dc1e40b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e412 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.431663:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834103.431665:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834103.431666:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834103.431684:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406223744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834103.431740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834103.431809:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787834103.431815:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406223872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834103.431840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834103.431870:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406223744 00000100:00100000:2.0:1787834103.431876:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406223744 00000100:00100000:2.0:1787834103.431914:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406223872 00000100:00100000:2.0:1787834103.431927:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406223872 00000100:00100000:2.0:1787834103.431950:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787834103.431958:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+23:3638:x1874679406223744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834103.431969:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834103.431990:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1e9c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e9c2 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.432001:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834103.432035:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+22:3638:x1874679406223744:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834103.432042:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787834103.432056:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787834103.432062:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635d75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+21:3638:x1874679406223872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834103.432070:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834103.432078:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600030e00/0x996d2fb20dc1e412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e40b expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.432088:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834103.432110:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635d75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:3638:x1874679406223872:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834103.432116:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787834103.432172:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406223872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834103.432181:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406223744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834103.432366:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.432374:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031800/0x996d2fb20dc1e761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e768 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834103.432386:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834103.432388:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834103.432390:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834103.432401:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406223232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834103.432431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787834103.432467:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834103.432476:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406223360:0@lo:39:umount.0 00000100:00100000:0.0:1787834103.432578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834103.432598:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406223488:0@lo:9:umount.0 00000100:00100000:0.0:1787834103.432621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834103.432638:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406223616:0@lo:9:umount.0 00000100:00100000:0.0:1787834103.432674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834103.432706:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406223360 00000100:00100000:0.0:1787834103.432710:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406223360 00000100:00100000:0.0:1787834103.432738:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787834103.432744:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874679406223360:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787834103.432859:0:17147:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e611 00000100:00080000:0.0:1787834103.432867:0:17147:0:(import.c:65:import_set_state_nolock()) ffff8df6067d1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787834103.432885:0:17147:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787834103.433012:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3637:x1874679406223360:12345-0@lo:39:umount.0 Request processed in 268us (433us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787834103.433019:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787834103.433048:0:19277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406223488 00000100:00100000:0.0:1787834103.433052:0:19277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406223488 00000100:00100000:0.0:1787834103.433083:0:19277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406223616 00000100:00100000:0.0:1787834103.433086:0:19277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406223616 00000100:00100000:0.0:1787834103.433106:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787834103.433112:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874679406223488:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787834103.433127:0:19277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e76f 00000100:00080000:0.0:1787834103.433131:0:19277:0:(import.c:65:import_set_state_nolock()) ffff8df502cc9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787834103.433167:0:19277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787834103.433591:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1874679406223488:12345-0@lo:9:umount.0 Request processed in 478us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834103.433599:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787834103.433615:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787834103.433621:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874679406223616:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787834103.433633:0:19277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e776 00000100:00080000:0.0:1787834103.433639:0:19277:0:(import.c:65:import_set_state_nolock()) ffff8df502ccd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787834103.433706:0:19277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787834103.433857:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1874679406223616:12345-0@lo:9:umount.0 Request processed in 236us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834103.433864:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787834103.433910:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6187e2000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787834103.433929:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406223360:0@lo:39:umount.0 00000100:00080000:0.0:1787834103.433942:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df50454a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787834103.433947:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787834103.433949:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787834103.433951:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406223488:0@lo:9:umount.0 00000100:00080000:0.0:1787834103.433959:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df63fb42000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787834103.433978:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787834103.433979:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787834103.433982:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406223616:0@lo:9:umount.0 00000100:00100000:2.0:1787834103.434059:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406223232 00000100:00100000:2.0:1787834103.434064:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406223232 00000100:00100000:2.0:1787834103.434098:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787834103.434105:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504776d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+20:3641:x1874679406223232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834103.434114:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834103.434130:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df620723800/0x996d2fb20dc1e768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e761 expref: 20 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834103.434153:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834103.434188:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504776d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a2d970c-4ae1-4256-8fee-b2c6594a1c06+19:3641:x1874679406223232:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834103.434194:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787834103.434240:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406223232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834103.434476:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df621292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3640:1874679406223104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834103.434821:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834103.435061:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834103.435107:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787834103.441010:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8df503f13490) has no exports 00000020:00000080:1.0:1787834103.498146:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e466 00000020:00000080:1.0:1787834103.498161:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df62ea25800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787834103.498286:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787834103.498386:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787834103.498396:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787834103.498401:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8df5039b8000) has no exports 00000020:00000080:0.0:1787834103.498717:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e45f 00000020:00000080:0.0:1787834103.498723:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df62ea7c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787834103.499108:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62ea25800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787834103.499367:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62ea7c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787834103.499420:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787834103.499428:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787834103.499431:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df62ea7d800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787834103.499433:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62ea7d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787834103.499437:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1787834103.574939:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834103.768330:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787834104.598030:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787834105.176801:0:17121:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787834105.176812:0:17121:0:(genops.c:885:class_export_put()) final put ffff8df602e45800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787834105.176827:0:17121:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000001:00080000:0.0:1787834105.176835:0:17121:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1787834105.176840:0:17121:0:(genops.c:885:class_export_put()) final put ffff8df50441b000/3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000001:00100000:0.0:1787834105.176844:0:17121:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4903173d-3c15-42de-bfe8-e4a9090d66c7 00000001:00080000:0.0:1787834105.176847:0:17121:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1787834105.176853:0:17121:0:(genops.c:885:class_export_put()) final put ffff8df50474e000/4903173d-3c15-42de-bfe8-e4a9090d66c7 00000020:00000080:1.0:1787834105.178092:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df602e45800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787834105.178145:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df50441b000/3b7b3847-f4f2-42ea-93f4-1f34e9067bef for lustre-MDT0000 00000020:00000080:1.0:1787834105.178174:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df50474e000/4903173d-3c15-42de-bfe8-e4a9090d66c7 for lustre-MDT0000 00000020:00000080:1.0:1787834105.178207:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df6065e5800 for lustre-MDT0000 00000020:00000080:1.0:1787834105.178212:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df504418000 for lustre-MDT0000 00000020:00000080:1.0:1787834105.178215:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df60665e000 for lustre-MDT0000 00000001:00100000:2.0:1787834105.180071:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787834105.180081:0:19463:0:(genops.c:885:class_export_put()) final put ffff8df502ccf000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787834105.180108:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4903173d-3c15-42de-bfe8-e4a9090d66c7 00000020:00000080:2.0:1787834105.180111:0:19463:0:(genops.c:885:class_export_put()) final put ffff8df50441e800/4903173d-3c15-42de-bfe8-e4a9090d66c7 00000020:00000080:0.0:1787834105.180161:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502ccf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787834105.180211:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df50441e800/4903173d-3c15-42de-bfe8-e4a9090d66c7 for lustre-OST0001 00000020:00000080:0.0:1787834105.180230:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502ccd800 for lustre-OST0001 00000020:00000080:0.0:1787834105.180234:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df50441f800 for lustre-OST0001 00000001:00100000:3.0:1787834105.181250:0:17874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787834105.181264:0:17874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1787834105.181270:0:17874:0:(genops.c:885:class_export_put()) final put ffff8df60343e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787834105.181330:0:17874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000001:00080000:3.0:1787834105.181336:0:17874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1787834105.181338:0:17874:0:(genops.c:885:class_export_put()) final put ffff8df5039e8800/3b7b3847-f4f2-42ea-93f4-1f34e9067bef 00000020:00000080:1.0:1787834105.187278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60343e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787834105.187369:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df6067d1800 for lustre-MDT0001 00000001:00100000:3.0:1787834105.188692:0:17874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4903173d-3c15-42de-bfe8-e4a9090d66c7 00000001:00080000:3.0:1787834105.188719:0:17874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1787834105.188724:0:17874:0:(genops.c:885:class_export_put()) final put ffff8df60665f800/4903173d-3c15-42de-bfe8-e4a9090d66c7 00000020:00000080:0.0:1787834105.188809:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039e8800/3b7b3847-f4f2-42ea-93f4-1f34e9067bef for lustre-MDT0001 00000020:00000080:0.0:1787834105.188865:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60665f800/4903173d-3c15-42de-bfe8-e4a9090d66c7 for lustre-MDT0001 00000020:00000080:0.0:1787834105.188889:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df5039ee000 for lustre-MDT0001 00000020:00000080:0.0:1787834105.188894:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df503f66000 for lustre-MDT0001 00000020:01000000:1.0:1787834105.559105:0:20714:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df60ffea180 - data ffff8df62ee27360/ffff8df5010d5000 00000020:01000000:1.0:1787834105.559270:0:20714:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df5010874e0 - data ffff8df62eda9798/ffff8df63c717000 00000001:00000004:1.0:1787834105.571097:0:20714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1787834105.621946:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787834105.621955:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787834105.621970:0:20714:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8df635a44b40 x1874679406223360/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787834113 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834105.622062:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787834105.622074:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787834105.624195:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787834105.624204:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1787834105.625446:0:20714:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787834105.625452:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787834105.632080:0:17165:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787834105.632088:0:17165:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1787834105.632100:0:17165:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787834105.637603:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787834105.637609:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1787834105.637619:0:20714:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787834105.637621:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787834105.637976:0:17167:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787834105.637980:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1787834105.638092:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787834105.639179:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e42e 00000020:00000080:2.0:1787834105.639188:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df61e60a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787834105.642931:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e443 00000020:00000080:2.0:1787834105.642944:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df61e60f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787834105.645363:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e60a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787834105.647405:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787834105.647420:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787834105.647430:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787834105.647435:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8df503f11a48) has no exports 00000004:01000000:2.0:1787834105.647632:0:20714:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787834105.647641:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e4a5 00000020:00000080:2.0:1787834105.647648:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df604e27000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787834105.647653:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787834105.647657:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787834105.647661:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787834105.647663:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8df635860000) has no exports 00000020:00000080:2.0:1787834105.647669:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e49e 00000020:00000080:2.0:1787834105.647672:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df63fb45000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787834105.648010:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e60f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787834105.648025:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df604e27000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787834105.648033:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63fb45000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787834105.648149:0:20714:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787834105.648153:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787834105.648158:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1787834105.648163:0:20714:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787834105.648165:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787834105.648206:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787834105.648212:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787834105.648220:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e490 00000020:00000080:2.0:1787834105.648225:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df604e27800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787834105.648229:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787834105.648232:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787834105.648235:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787834105.648237:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8df5039bb490) has no exports 00000020:00000080:2.0:1787834105.648241:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e489 00000020:00000080:2.0:1787834105.648243:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df604e24000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787834105.648541:0:20714:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787834105.648545:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787834105.648556:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1787834105.648560:0:20714:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787834105.648561:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787834105.648581:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787834105.648586:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787834105.648595:0:20714:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787834105.648600:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e47b 00000020:00000080:3.0:1787834105.648688:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df63fb42000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787834105.648696:0:36:0:(genops.c:885:class_export_put()) final put ffff8df604e21800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787834105.648699:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df604e21800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787834105.648704:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787834105.648870:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df604e27800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787834105.648876:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df604e24000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787834105.648880:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df50454a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787834105.648884:0:36:0:(genops.c:885:class_export_put()) final put ffff8df604e24800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787834105.648886:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df604e24800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787834105.648889:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787834105.648965:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df62ea21000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787834105.649005:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787834105.649009:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787834105.649014:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787834105.649016:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8df60ef48000) has no exports 00000020:00000080:2.0:1787834105.649021:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e474 00000020:00000080:2.0:1787834105.649024:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df6187e0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787834105.651289:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62ea21000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787834105.651306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df6187e0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787834105.652735:0:20714:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1787834105.652742:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787834105.652746:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787834105.652772:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787834105.652814:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787834105.652824:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787834105.653015:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787834105.653020:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787834105.653025:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df61e60a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787834105.653029:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e60a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787834105.653036:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787834105.653163:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df6187e2000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787834105.653183:0:37:0:(genops.c:885:class_export_put()) final put ffff8df635801800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787834105.653186:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df635801800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787834105.653190:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787834105.653325:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e44a 00000020:00000080:3.0:1787834105.653333:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df61e60e800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787834105.653349:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787834105.653353:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787834105.653358:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787834105.653362:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8df635428000) has no exports 00000020:00000080:3.0:1787834105.653382:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787834105.653385:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787834105.653389:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e451 00000020:00000080:3.0:1787834105.653392:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df61e60c800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787834105.653400:0:20714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df504d9f000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787834105.653403:0:20714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df504d9f000 3 00000020:01000004:3.0:1787834105.653405:0:20714:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df504d9f000 from lustre-MDT0000 00000020:00000080:3.0:1787834105.653420:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787834105.653423:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787834105.653425:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df61e609800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787834105.653427:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e609800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787834105.653433:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787834105.653471:0:20714:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1787834105.653475:0:20714:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787834105.653478:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787834105.653481:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787834105.653483:0:20714:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787834105.653490:0:20714:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8df503c56800 1a2d970c-4ae1-4256-8fee-b2c6594a1c06 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787834105.653496:0:20714:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8df60ef4b490) has exports, disconnecting them 00000020:00080000:3.0:1787834105.653500:0:20714:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8df503c56800), last request at 1787834016 00000020:00000080:3.0:1787834105.653514:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e3f6 00000020:00010000:3.0:1787834105.653526:0:20714:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8df503c56800: total 2 00000100:00080000:3.0:1787834105.653530:0:20714:0:(import.c:65:import_set_state_nolock()) ffff8df502eb6000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787834105.653551:0:20714:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df503c56800): rc 0 00000020:00080000:3.0:1787834105.653555:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8df60ef4b490) has no exports 00000020:00000080:0.0:1787834105.653634:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e60e800/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:3.0:1787834105.653640:0:17135:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8df502fbc600:17135] 1 exiting: rc = 0 00000020:00000080:0.0:1787834105.653641:0:37:0:(genops.c:885:class_export_put()) final put ffff8df61e60c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787834105.653645:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e60c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787834105.653651:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787834105.653698:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e60c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1787834105.653725:0:17129:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8df503c56800: total 0 00010000:00010000:3.0:1787834105.653729:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834105.653765:0:17129:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8df503c56800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787834105.653797:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600030800/0x996d2fb20dc1e681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e67a expref: 14 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.653814:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1e9ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e9a6 expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.653823:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676400/0x996d2fb20dc1e5d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e5cb expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.653833:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504677c00/0x996d2fb20dc1e523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e51c expref: 11 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.653845:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504ccd000/0x996d2fb20dc1e404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e3fd expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.653853:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504ccd600/0x996d2fb20dc1e6f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e6ea expref: 9 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.655154:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b7600/0x996d2fb20dc1e99f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e998 expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.655171:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676e00/0x996d2fb20dc1e515 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e50e expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.655274:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1e9bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e9b4 expref: 6 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.655288:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676a00/0x996d2fb20dc1e531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e52a expref: 5 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.655298:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df620722000/0x996d2fb20dc1e71b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e714 expref: 4 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.655307:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504ccd400/0x996d2fb20dc1e75a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e753 expref: 3 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.655319:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504ccc800/0x996d2fb20dc1e657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x996d2fb20dc1e650 expref: 2 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834105.655331:0:17129:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8df503c56800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787834105.655360:0:17129:0:(genops.c:885:class_export_put()) final put ffff8df503c56800/1a2d970c-4ae1-4256-8fee-b2c6594a1c06 00010000:00010000:3.0:1787834105.655428:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834105.655431:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834105.655434:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834105.655479:0:17133:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8df502fbc200:17133] 0 exiting: rc = 1 00000100:00100000:3.0:1787834105.655495:0:17136:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8df502fbde00:17136] 2 exiting: rc = 0 00000020:00000080:0.0:1787834105.655606:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503c56800/1a2d970c-4ae1-4256-8fee-b2c6594a1c06 for MGS 00000020:00000080:0.0:1787834105.655640:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502eb6000 for MGS 00000100:00100000:3.0:1787834105.655721:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.655728:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.655737:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656385:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656398:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656404:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656409:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656414:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656420:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656434:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656438:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656444:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656449:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656454:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656459:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656464:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656469:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656474:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656480:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656484:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656490:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656495:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656500:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656505:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656510:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656515:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656519:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656524:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656529:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656534:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656539:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656544:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656548:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656553:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656557:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656561:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656566:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656570:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656575:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656579:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656584:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656589:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656593:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656598:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656608:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656613:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656618:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656623:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656628:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656633:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656638:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656643:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656647:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656652:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656657:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656662:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656666:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656671:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656675:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656680:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656684:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656689:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656693:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834105.656698:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787834105.658047:0:20714:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df63c1138a0 - data ffff8df62ee6a360/ffff8df63a867c00 00000020:01000000:0.0:1787834105.658160:0:20714:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df50277b6c0 - data ffff8df62eca6000/ffff8df63c5c8400 00000020:00000080:0.0:1787834105.658664:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e3da 00000020:00000080:0.0:1787834105.658672:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df503c52000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787834105.658681:0:20714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df504d9f000 from MGS, refs=2 00000020:01000004:0.0:1787834105.658684:0:20714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df504d9f000 2 00000020:01000004:0.0:1787834105.658686:0:20714:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df504d9f000 from MGS 00000020:00000080:0.0:1787834105.658703:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787834105.658708:0:20714:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787834105.658711:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df503c50800/MGS 00000020:00000080:0.0:1787834105.658713:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503c50800/MGS for MGS 00000020:01000000:0.0:1787834105.658718:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1787834105.658827:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503c52000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787834105.659063:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787834105.659068:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787834105.659073:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787834105.659080:0:20714:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8df6063cf000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787834105.659086:0:20714:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8df635864ed8) has exports, disconnecting them 00000020:00080000:0.0:1787834105.659091:0:20714:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8df6063cf000), last request at 1787834016 00000020:00000080:0.0:1787834105.659094:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e4dd 00000020:00080000:0.0:1787834105.659104:0:20714:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df6063cf000): rc 0 00000020:00000080:0.0:1787834105.659108:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df6063cf000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787834105.661511:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df6063cf000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787834105.666809:0:20714:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787834105.666819:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787834105.666824:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787834105.666831:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787834105.666883:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502521800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787834105.667056:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787834105.667065:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787834105.667071:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df502523800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787834105.667075:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502523800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787834105.667081:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787834105.667168:0:20714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df504d9f000 1 00000020:00000080:3.0:1787834105.667175:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e3cc 00000020:00000080:3.0:1787834105.667182:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df503c57000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787834105.667190:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787834105.667208:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503c57000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787834105.667219:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787834105.667224:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787834105.667227:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8df635861a48) has no exports 00000020:00000080:2.0:1787834105.795651:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787834105.795665:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787834105.795671:0:20714:0:(genops.c:885:class_export_put()) final put ffff8df504d9b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787834105.795675:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffff8df504d9b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787834105.795686:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787834105.796094:0:20714:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df504d9e000 00000020:02000400:2.0:1787834105.796153:0:20714:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787834106.646826:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834107.221932:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406224000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787834107.222007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834107.222100:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406224000 00000100:00100000:2.0:1787834107.222108:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406224000 00000100:00100000:2.0:1787834107.222188:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787834107.222198:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406224000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787834107.222229:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834107.222797:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406224000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 597us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834107.222806:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787834107.222834:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787834107.222920:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406224000:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787834107.674137:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834107.734121:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406224128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834107.734193:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834107.734351:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406224128 00000100:00100000:2.0:1787834107.734361:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406224128 00000100:00100000:2.0:1787834107.734479:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787834107.734487:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1874679406224128:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787834107.734496:0:17147:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787834107.734539:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1874679406224128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (345us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787834107.734546:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787834107.734569:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6012ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406224256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787834107.735699:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:2.0:1787834107.735798:0:3641:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1787834107.736108:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406224256 00000100:00100000:3.0:1787834107.736115:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406224256 00000100:00100000:3.0:1787834107.736174:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787834107.736182:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406224256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787834107.736209:0:18651:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787834107.736259:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406224256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834107.736266:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787834107.736346:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787834107.738928:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406224768:0@lo:400:kworker.0 00000100:00100000:3.0:1787834107.738996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834107.739155:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406224768 00000100:00100000:0.0:1787834107.739162:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406224768 00000100:00100000:0.0:1787834107.739218:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787834107.739228:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406224768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834107.739278:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406224768:12345-0@lo:400:kworker.0 Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834107.739286:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1787834107.739308:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787834107.739345:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6012ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406224256:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787834107.739386:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8df636ad43c0 x1874679406224768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834107.739396:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406224768:0@lo:400:kworker.0 00000100:00100000:3.0:1787834107.739407:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787834107.739426:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406224384:0@lo:400:kworker.0 00000400:00000100:3.0:1787834107.739520:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874679406224384 offset 0 length 224: 4 00000100:00100000:3.0:1787834107.739546:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406224896:0@lo:400:kworker.0 00000100:00100000:3.0:1787834107.739570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834107.739638:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406224896 00000100:00100000:0.0:1787834107.739643:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406224896 00000100:00100000:0.0:1787834107.739672:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787834107.739677:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e121e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874679406224896:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787834107.739683:0:17141:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787834107.739717:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e121e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874679406224896:12345-0@lo:400:kworker.0 Request processed in 38us (145us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787834107.739722:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787834107.739785:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787834107.739797:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8df502ccb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787834107.739801:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787834107.757577:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787834107.758479:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8df602e42000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787834107.758489:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787834107.758495:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8df602e42000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787834107.758500:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1787834107.758510:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8df602e42000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834107.765326:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406224512:0@lo:400:kworker.0 00000100:00100000:2.0:1787834107.765410:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834107.765453:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406225024:0@lo:400:kworker.0 00000100:00100000:2.0:1787834107.765477:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834107.765502:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787834107.765509:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406224640:0@lo:400:kworker.0 00000100:00100000:2.0:1787834107.765546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834107.765617:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a44b40 x1874679406225152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787834107.765674:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406225152:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787834107.765708:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834107.769429:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406225152 00000100:00100000:2.0:1787834107.769445:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406225152 00000100:00100000:2.0:1787834107.769498:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787834107.769506:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406225152:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1787834107.769530:0:17146:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1787834107.773055:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8df502ccb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834107.773227:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 535 00000100:00080000:0.0:1787834107.773237:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df502ccb800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834107.773258:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406224512 00000100:00100000:0.0:1787834107.773266:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406224512 00000100:00100000:0.0:1787834107.773313:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406225024 00000100:00100000:0.0:1787834107.773316:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406225024 00000100:00100000:0.0:1787834107.773471:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406224640 00000100:00100000:3.0:1787834107.773558:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787834107.773570:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406225024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834107.773661:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406225024:12345-0@lo:400:kworker.0 Request processed in 93us (8182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834107.773669:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787834107.773687:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787834107.773692:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874679406224512:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787834107.773698:0:17143:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787834107.773725:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874679406224512:12345-0@lo:400:kworker.0 Request processed in 32us (8316us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787834107.773731:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787834107.773783:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787834107.773787:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8df60665c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787834107.773791:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787834107.773794:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8df60665c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834107.773797:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:3.0:1787834107.773801:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8df60665c800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834107.773830:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e1221c0 x1874679406225280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787834107.773864:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406224512:0@lo:400:kworker.0 00010000:00080000:3.0:1787834107.773881:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8df636ad5a40 x1874679406225024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834107.773903:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406225024:0@lo:400:kworker.0 00000100:00100000:3.0:1787834107.773934:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406225280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787834107.773970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834107.773992:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406225280 00000100:00100000:3.0:1787834107.773995:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406225280 00000100:00100000:3.0:1787834107.774012:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787834107.774016:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e1203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406225280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1787834107.774034:0:17143:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787834107.774060:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e1203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406225280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 43us (90us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787834107.774079:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787834107.774108:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df60665c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787834107.774113:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787834107.774116:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406225280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787834107.774242:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406224640 00000100:00100000:0.0:1787834107.774268:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787834107.774273:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63c6a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874679406224640:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787834107.774279:0:17142:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787834107.774315:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63c6a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874679406224640:12345-0@lo:400:kworker.0 Request processed in 41us (8769us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787834107.774322:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787834107.774350:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787834107.777322:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787834107.777331:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8df6067d4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787834107.777336:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787834107.777341:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8df6067d4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834107.777344:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1787834107.777353:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df6067d4000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834107.777387:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6359d83c0 x1874679406225408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787834107.777482:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406225408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787834107.777545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834107.777714:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406224640:0@lo:400:kworker.0 00000100:00100000:0.0:1787834107.777782:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406225408 00000100:00100000:0.0:1787834107.777787:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406225408 00000100:00100000:0.0:1787834107.777821:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787834107.777828:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e1221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874679406225408:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1787834107.777847:0:17142:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787834107.778032:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e1221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874679406225408:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 202us (485us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787834107.778039:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787834107.778154:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6359d8f00 x1874679406225536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787834107.778168:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406224896:0@lo:400:kworker.0 00000100:00080000:3.0:1787834107.778231:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6067d4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787834107.778236:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787834107.778239:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406225408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787834107.778264:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406225536:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787834107.778597:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834107.778681:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406225536 00000100:00100000:0.0:1787834107.778686:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406225536 00000100:00100000:0.0:1787834107.778718:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787834107.778723:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406225536:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1787834107.778737:0:17141:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787834107.778802:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406225536:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 78us (205us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787834107.778809:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1787834107.778875:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502ccb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787834107.778880:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787834107.778883:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406225536:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787834107.819710:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406225152:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 50192us (53989us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787834107.819727:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787834107.819896:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df602e42000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787834107.819903:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787834107.819907:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406225152:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1787834108.703956:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787834109.274976:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787834109.274994:0:18644:0:(genops.c:885:class_export_put()) final put ffff8df502cca800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787834109.275119:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502cca800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787834109.275273:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502cc9800 for lustre-OST0000 00000020:01000004:0.0:1787834109.361729:0:20915:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787834109.397497:0:20915:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787834109.397543:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.397554:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.397560:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.397565:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.397583:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787834109.397587:0:20915:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787834109.397608:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787834109.397613:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1787834109.397618:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1787834109.397618:0:20915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787834109.397623:0:20915:0:(import.c:65:import_set_state_nolock()) ffff8df60665c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1787834109.397625:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787834109.397627:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787834109.397629:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787834109.397631:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787834109.397633:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504ccc400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834109.397636:0:19480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.397645:0:19480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834109.397652:0:19480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834109.397658:0:19480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787834109.397660:0:19480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787834109.397662:0:19480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787834109.397712:0:19480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.397718:0:19480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787834109.397784:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63c6abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406225664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834109.397850:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834109.397948:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406225664 00000100:00100000:1.0:1787834109.397954:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406225664 00000100:00100000:1.0:1787834109.397988:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787834109.397994:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e121a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874679406225664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787834109.398000:0:18674:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787834109 with bad export cookie 11055545102045930486 00010000:00010000:0.0:1787834109.398513:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398523:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398530:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398544:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398560:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787834109.398565:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398572:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398579:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398585:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398596:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787834109.398602:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398609:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398615:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398621:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398638:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787834109.398645:0:20915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398652:0:20915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398658:0:20915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398665:0:20915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834109.398672:0:20915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787834109.398676:0:20915:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1787834109.398697:0:20915:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787834109.398701:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787834109.398706:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787834109.398711:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787834109.398716:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8df502cce000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787834109.398721:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8df60343d000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787834109.398726:0:20915:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8df5027c4ed8) has exports, disconnecting them 00000020:00080000:0.0:1787834109.398730:0:20915:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8df502cce000), last request at 1787834107 00000020:00000080:0.0:1787834109.398737:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e745 00000100:00080000:0.0:1787834109.398771:0:20915:0:(import.c:65:import_set_state_nolock()) ffff8df502cc8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787834109.398813:0:20915:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df502cce000): rc 0 00000020:00000080:0.0:1787834109.398815:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df502cce000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787834109.398825:0:20915:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8df60343d000), last request at 1787834107 00000020:00000080:0.0:1787834109.398835:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e6ab 00000100:00080000:0.0:1787834109.398840:0:20915:0:(import.c:65:import_set_state_nolock()) ffff8df603438000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787834109.398847:0:20915:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df60343d000): rc 0 00000020:00000080:0.0:1787834109.398849:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60343d000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787834109.398855:0:20915:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9fc9c169bae0 00000100:00080000:0.0:1787834109.398872:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787834109.398891:0:20915:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8df63c6aad00 x1874679406224128/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787834123 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787834109.399814:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.399828:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504ccc400/0x996d2fb20dc1e5cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e5d2 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.399842:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787834109.399846:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.399853:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834109.399857:0:19480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.399884:0:19480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834109.399893:0:19480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834109.399898:0:19480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787834109.399901:0:19480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1787834109.399903:0:19480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1787834109.399936:0:19480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.399943:0:19480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787834109.399962:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.399979:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031400/0x996d2fb20dc1e52a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e531 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.399990:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787834109.399993:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.399999:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834109.400002:0:19480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.400009:0:19480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834109.400016:0:19480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834109.400021:0:19480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787834109.400023:0:19480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787834109.400025:0:19480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787834109.400038:0:19480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.400044:0:19480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787834109.400049:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.400055:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031600/0x996d2fb20dc1e753 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e75a expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.400079:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834109.400082:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.400088:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834109.400091:0:19480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.400098:0:19480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834109.400104:0:19480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834109.400110:0:19480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787834109.400112:0:19480:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787834109.400114:0:19480:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787834109.400129:0:19480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.400134:0:19480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787834109.400825:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:1.0:1787834109.403469:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834109.403482:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834109.403493:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787834109.403497:0:17129:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834109.403527:0:17129:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787834109.403535:0:17129:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834109.403541:0:17129:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787834109.403543:0:17129:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787834109.403547:0:17129:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787834109.403595:0:17129:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834109.403600:0:17129:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787834109.403614:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834109.403620:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df620722c00/0x996d2fb20dc1e51c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e523 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834109.403637:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834109.403639:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834109.403641:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787834109.403652:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502cce000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1787834109.403707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60343d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787834109.403728:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502cc8800 for lustre-MDT0001 00000020:00000080:1.0:1787834109.403732:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df603438000 for lustre-MDT0001 00000100:00100000:1.0:1787834109.403836:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e121a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874679406225664:12345-0@lo:103:ldlm_bl.0 Request processed in 5837us (5982us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787834109.403845:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834109.404305:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406224128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834109.404348:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406226176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834109.404396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787834109.404454:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.117@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787834109.404460:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8df61e603000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787834109.404464:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787834109.405149:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834109.405162:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b6000/0x996d2fb20dc1e9b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x996d2fb20dc1e9bb expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787834109.406485:0:20915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787834109.406495:0:20915:0:(import.c:65:import_set_state_nolock()) ffff8df602e42000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787834109.406663:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787834109.406668:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787834109.406681:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787834109.406769:0:20915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787834109.406797:0:20915:0:(import.c:65:import_set_state_nolock()) ffff8df602ac8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787834109.406812:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787834109.406814:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1787834109.406829:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787834109.406893:0:20915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787834109.406894:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406226304:0@lo:9:umount.0 00000100:00080000:0.0:1787834109.406901:0:20915:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787834109.406936:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8df5027c4ed8) has no exports 00000100:00100000:1.0:1787834109.406958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834109.406999:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406226432:0@lo:9:umount.0 00000100:00100000:0.0:1787834109.406999:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406226304 00000100:00100000:0.0:1787834109.407006:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406226304 00000100:00100000:1.0:1787834109.407019:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834109.407045:0:19277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406226432 00000100:00100000:1.0:1787834109.407049:0:19277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406226432 00000100:00100000:0.0:1787834109.407059:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787834109.407067:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874679406226304:12345-0@lo:9:umount.0 00000100:00100000:1.0:1787834109.407072:0:19277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787834109.407077:0:19277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874679406226432:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787834109.407091:0:19277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e77d 00000020:00000080:0.0:1787834109.407091:0:18648:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e6d5 00000100:00080000:1.0:1787834109.407098:0:19277:0:(import.c:65:import_set_state_nolock()) ffff8df60345f000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1787834109.407098:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8df6065e1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787834109.407134:0:19277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000001:00000004:0.0:1787834109.407135:0:18648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787834109.407268:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3637:x1874679406226304:12345-0@lo:9:umount.0 Request processed in 201us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834109.407276:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787834109.407295:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787834109.407298:0:17137:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787834109.407385:0:19277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1874679406226432:12345-0@lo:9:umount.0 Request processed in 306us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834109.407392:0:19277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787834109.407428:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df635806800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787834109.407443:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787834109.407445:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787834109.407448:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406226432:0@lo:9:umount.0 00000100:00080000:1.0:1787834109.407458:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df602ac8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787834109.407465:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787834109.407467:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787834109.407469:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406226304:0@lo:9:umount.0 00010000:00010000:1.0:1787834109.407492:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834109.407812:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406226176 00000100:00100000:2.0:1787834109.407817:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406226176 00000100:00100000:2.0:1787834109.407939:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787834109.407945:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e1212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1874679406226176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787834109.407950:0:17126:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787834109 with bad export cookie 11055545102045930486 00000100:00100000:2.0:1787834109.407991:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e1212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1874679406226176:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (3595us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787834109.407997:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787834109.408014:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787834109.416548:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.117@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787834109.416554:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787834109.416565:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df636ad5e00 x1874679406224384/t0(0) o400->MGC192.168.203.117@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787834123 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834109.416580:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df63c6abc00 x1874679406225664/t0(0) o103->MGC192.168.203.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787834125 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834109.416590:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df636ad52c0 x1874679406226176/t0(0) o103->MGC192.168.203.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787834125 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787834109.416605:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787834109.416608:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787834109.416611:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787834109.416613:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:0:1874679406226048:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787834109.416616:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8df61e603000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834109.416640:0:3641:0:(import.c:510:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1787834109.416650:0:3641:0:(import.c:624:import_select_connection()) MGC192.168.203.117@tcp: import ffff8df61e603000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834109.416687:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e120000 x1874679406226560/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787834109.416707:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:0:1874679406225792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834109.416728:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3638:1874679406224384:0@lo:400:kworker.0 00000100:00100000:2.0:1787834109.416772:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787834109.416780:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:0:1874679406225920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787834109.416793:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3637:1874679406226560:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1787834109.416856:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874679406226560 offset 0 length 520: 4 00000100:00100000:3.0:1787834109.422040:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406226176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834109.422051:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63c6abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3641:1874679406225664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834109.428195:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834109.428201:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834109.428203:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787834109.440020:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8df5027c4ed8) has no exports 00000020:01000000:2.0:1787834109.506153:0:20915:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df60ffeac00 - data ffff8df61270d6c0/ffff8df5010d6000 00000020:01000000:2.0:1787834109.506319:0:20915:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df63c113900 - data ffff8df6092ea5e8/ffff8df606693800 00000001:00000004:2.0:1787834109.517882:0:20915:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1787834109.593796:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787834109.593805:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787834109.593812:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787834109.595623:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787834109.595631:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787834109.595650:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787834109.595652:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787834109.596890:0:17882:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787834109.596897:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787834109.596929:0:17882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787834109.604005:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787834109.604016:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1787834109.604043:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787834109.604046:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787834109.604442:0:17884:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787834109.604447:0:17884:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1787834109.604460:0:17884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787834109.605738:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e53f 00000020:00000080:1.0:1787834109.605775:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60ef72000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787834109.606391:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e554 00000020:00000080:1.0:1787834109.606398:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60ef73000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787834109.606402:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787834109.606406:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787834109.606414:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787834109.606417:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8df635863490) has no exports 00000004:01000000:1.0:1787834109.606680:0:20915:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787834109.606689:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e5a8 00000020:00000080:1.0:1787834109.606694:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df6065c8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787834109.606698:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787834109.606702:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787834109.606706:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787834109.606708:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8df5027c0000) has no exports 00000020:00000080:1.0:1787834109.606713:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e5a1 00000020:00000080:1.0:1787834109.606716:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df611640000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787834109.607171:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef72000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787834109.607185:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef73000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1787834109.607189:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df6065c8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787834109.607194:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df611640000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787834109.607251:0:20915:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787834109.607255:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787834109.607260:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1787834109.607265:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787834109.607267:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787834109.607305:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787834109.607312:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787834109.607318:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e593 00000020:00000080:1.0:1787834109.607323:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60ef74800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787834109.607327:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787834109.607330:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787834109.607334:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787834109.607336:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8df5027c1a48) has no exports 00000020:00000080:1.0:1787834109.607341:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e585 00000020:00000080:1.0:1787834109.607352:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60ef71800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787834109.607634:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df635806800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787834109.607641:0:8:0:(genops.c:885:class_export_put()) final put ffff8df60ef76000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787834109.607643:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef76000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787834109.607648:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787834109.607737:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef74800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787834109.607742:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef71800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787834109.608958:0:20915:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787834109.608965:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787834109.608969:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787834109.608975:0:20915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787834109.608978:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787834109.609029:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787834109.609038:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787834109.609050:0:20915:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787834109.609058:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e577 00000020:00000080:0.0:1787834109.609058:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df602ac8800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787834109.609066:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60ef74000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787834109.609067:0:8:0:(genops.c:885:class_export_put()) final put ffff8df60ef76800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787834109.609072:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef76800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787834109.609077:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787834109.609181:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787834109.609186:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787834109.609192:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787834109.609196:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8df60ef49a48) has no exports 00000020:00000080:1.0:1787834109.609203:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e570 00000020:00000080:1.0:1787834109.609208:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df602e41000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787834109.609479:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef74000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787834109.609486:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df602e41000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787834109.613088:0:20915:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787834109.613097:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787834109.613112:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787834109.613119:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787834109.613170:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787834109.613207:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df602e42000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787834109.613296:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787834109.613376:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df620707000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787834109.613381:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff8df620707000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1787834109.613387:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787834109.613735:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787834109.613741:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787834109.613744:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df635800800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787834109.613746:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff8df635800800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787834109.613814:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787834109.613926:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e55b 00000020:00000080:0.0:1787834109.613934:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60ef75800/lustre-MDD0001_UUID 00000020:01000000:0.0:1787834109.613949:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787834109.613953:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787834109.613958:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787834109.614032:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8df5027c3490) has no exports 00000020:00000080:2.0:1787834109.614091:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef75800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1787834109.614133:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787834109.614137:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787834109.614140:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60ef71000/lustre-MDD0001_UUID 00000020:00000080:0.0:1787834109.614143:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef71000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1787834109.614147:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1787834109.614388:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e562 00000020:00000080:0.0:1787834109.614393:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60ef72800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787834109.614410:0:20915:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df611643000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787834109.614413:0:20915:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df611643000 2 00000020:01000004:0.0:1787834109.614416:0:20915:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df611643000 from lustre-MDT0001 00000020:00000080:0.0:1787834109.614432:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787834109.614436:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787834109.614438:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df60ef77000/lustre-MDT0001_UUID 00000020:00000080:0.0:1787834109.614449:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef77000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787834109.614455:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787834109.614513:0:20915:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787834109.614517:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787834109.614519:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787834109.614523:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787834109.614529:0:20915:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8df606658000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787834109.614535:0:20915:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8df60ef4ced8) has exports, disconnecting them 00000020:00080000:0.0:1787834109.614540:0:20915:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8df606658000), last request at 1787834031 00000020:00000080:0.0:1787834109.614543:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e5e0 00000020:00080000:0.0:1787834109.614554:0:20915:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df606658000): rc 0 00000020:00000080:0.0:1787834109.614558:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df606658000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787834109.614895:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60ef72800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787834109.614902:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df606658000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787834109.624015:0:20915:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787834109.624023:0:20915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787834109.624028:0:20915:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787834109.624034:0:20915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787834109.624064:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df60665c800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787834109.624315:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787834109.624324:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787834109.624329:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df504748800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787834109.624332:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff8df504748800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787834109.624337:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787834109.624731:0:20915:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df611643000 1 00000020:00000080:2.0:1787834109.624737:0:20915:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e507 00000020:00000080:2.0:1787834109.624744:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df63435c000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787834109.624771:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787834109.624781:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63435c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787834109.624792:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787834109.624797:0:20915:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787834109.624800:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8df63542ced8) has no exports 00010000:00010000:2.0:1787834109.718938:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787834109.760355:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787834109.760372:0:20915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787834109.760377:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df611647000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787834109.760383:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff8df611647000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787834109.760393:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787834109.760514:0:20915:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df611642000 00000020:01000000:3.0:1787834109.760538:0:20915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787834109.760542:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787834109.760547:0:20915:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787834109.760551:0:20915:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8df503f14ed8) has no exports 00000100:00100000:3.0:1787834109.760652:0:17143:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8df611f20000:17143] 2 exiting: rc = 0 00000100:00100000:1.0:1787834109.760687:0:18167:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8df63b2d1800:18167] 3 exiting: rc = 0 00000100:00100000:2.0:1787834109.760796:0:17141:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8df502fbca00:17141] 0 exiting: rc = 1 00000100:00100000:0.0:1787834109.760908:0:17142:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8df611f21200:17142] 1 exiting: rc = 0 00000100:00100000:3.0:1787834109.760982:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.760991:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.760998:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761005:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761010:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761016:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761021:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761027:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761033:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761039:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761043:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761050:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761068:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761073:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761078:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761083:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761088:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761094:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761111:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761119:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761124:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761129:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761136:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761141:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761147:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761152:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761158:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761164:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761169:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761175:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761180:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761186:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761191:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761196:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761201:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761205:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761212:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761218:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761223:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761230:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761237:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761242:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761248:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761253:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761258:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761263:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761268:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761282:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761287:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761291:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761296:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761301:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761306:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761310:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761315:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761321:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761326:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761331:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761336:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761342:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761347:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761352:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761357:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.761362:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.771893:0:17145:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8df611f21a00:17145] 1 exiting: rc = 0 00000100:00100000:1.0:1787834109.772099:0:17144:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8df611f21800:17144] 0 exiting: rc = 1 00000100:00100000:1.0:1787834109.772176:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772184:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772190:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772195:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772200:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772205:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772210:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772215:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772220:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772225:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772229:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772234:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772240:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772244:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772263:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772268:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772273:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772278:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772288:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772293:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772297:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772302:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772307:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772312:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772317:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772321:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772325:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772331:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772335:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772340:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772345:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772350:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772355:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772360:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772364:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772369:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772374:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772380:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772385:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772391:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772398:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772403:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772409:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772415:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772420:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772426:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772431:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772436:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772440:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772453:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772458:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772463:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772468:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772474:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772480:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772485:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772491:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772495:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772500:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772504:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772508:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772514:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772520:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.772526:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.773284:0:17147:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8df6030aaa00:17147] 1 exiting: rc = 0 00000100:00100000:2.0:1787834109.774613:0:17146:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8df6030abc00:17146] 0 exiting: rc = 1 00000100:00100000:1.0:1787834109.775136:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775144:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775150:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775155:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775162:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775167:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775172:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775178:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775196:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775202:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775207:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775213:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775219:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775225:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775231:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775237:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775242:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775247:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775253:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775258:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775291:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775298:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775304:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775310:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775316:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775322:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775328:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775334:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775339:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775345:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775349:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775355:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775374:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775381:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775387:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775393:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775399:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775404:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775410:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775416:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775422:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775427:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775433:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775438:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775458:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775464:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775470:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775476:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775482:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775488:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775493:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775499:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775505:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775510:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775515:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775529:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775547:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775554:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775559:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775565:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775572:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775577:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775583:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.775589:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.786327:0:17148:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8df503c44e00:17148] 0 exiting: rc = 1 00000100:00100000:3.0:1787834109.786537:0:17149:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8df63b181600:17149] 1 exiting: rc = 0 00000100:00100000:1.0:1787834109.786631:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.786638:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.786999:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787005:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787011:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787016:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787020:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787025:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787031:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787035:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787040:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787046:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787051:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787056:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787061:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787067:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787072:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787076:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787082:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787087:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787092:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787097:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787102:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787107:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787112:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787115:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787130:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787134:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787137:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787140:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787143:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787147:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787150:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787153:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787217:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787222:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787226:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787229:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787233:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787236:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787239:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787243:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787246:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787249:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787251:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787254:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787257:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787260:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787262:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787265:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787268:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787271:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787274:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787277:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787280:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787283:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787286:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787288:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787291:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787294:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787296:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787305:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787308:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.787312:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.788395:0:17150:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8df503c45600:17150] 0 exiting: rc = 1 00000100:00100000:2.0:1787834109.788463:0:17151:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8df503c44400:17151] 1 exiting: rc = 0 00000100:00100000:0.0:1787834109.788532:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788540:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788545:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788551:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788558:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788563:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788568:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788573:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788578:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788584:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788590:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788596:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788601:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788607:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788611:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788616:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788621:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788627:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788643:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788648:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788653:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788658:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788664:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788669:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788674:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788679:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788684:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788689:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788694:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788698:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788703:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788708:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788712:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788718:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788723:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.788742:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.789968:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.789982:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.789987:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.789992:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790002:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790007:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790012:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790018:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790023:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790028:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790033:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790039:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790044:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790049:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790054:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790059:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790063:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790080:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790085:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790091:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790096:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790101:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790105:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790110:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790114:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790119:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790124:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834109.790129:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834109.791499:0:17153:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8df63580a200:17153] 1 exiting: rc = 0 00000100:00100000:2.0:1787834109.791809:0:17152:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8df503c45800:17152] 0 exiting: rc = 1 00000100:00100000:1.0:1787834109.791923:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791930:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791935:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791941:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791946:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791952:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791957:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791962:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791968:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791973:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791979:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791984:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791989:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791994:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.791999:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792005:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792010:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792014:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792019:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792023:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792028:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792033:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792037:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792042:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792046:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792051:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792055:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792060:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792065:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792071:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792076:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792081:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792095:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792100:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792105:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792110:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792116:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792120:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792125:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792130:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792139:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792144:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792149:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792155:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792160:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792165:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792170:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792175:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792179:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792184:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792189:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792194:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792199:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792204:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792209:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792214:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792219:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792224:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792228:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792233:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792238:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792242:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792246:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792251:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.792839:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8df635b88800:17156] 2 exiting: rc = 0 00000100:00100000:2.0:1787834109.794385:0:17154:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8df635b88c00:17154] 0 exiting: rc = 1 00000100:00100000:3.0:1787834109.794742:0:17155:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8df635b88400:17155] 1 exiting: rc = 0 00000100:00100000:1.0:1787834109.795866:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795885:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795908:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795914:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795920:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795925:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795953:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795960:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795966:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795972:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795977:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795983:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795989:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.795995:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796000:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796006:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796011:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796016:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796022:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796027:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796032:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796038:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796044:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796050:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796056:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796061:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796067:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796072:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796078:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796083:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796104:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796113:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796119:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796125:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796130:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796137:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796142:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796154:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796160:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796166:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796172:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796178:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796183:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796188:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796193:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796199:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796206:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796212:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796218:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796232:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796238:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796245:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796250:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796257:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796280:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796286:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796293:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796298:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796304:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796310:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796316:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796321:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796326:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834109.796332:0:20915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787834109.803257:0:20915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787834109.803270:0:20915:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787834109.803276:0:20915:0:(genops.c:885:class_export_put()) final put ffff8df61e600000/MDS_uuid 00000020:00000080:1.0:1787834109.803280:0:20915:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e600000/MDS_uuid for MDS 00000020:01000000:1.0:1787834109.803285:0:20915:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787834109.803459:0:20915:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787834110.741892:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834111.765978:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834112.792980:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787834112.853940:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787834112.853953:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834112.853956:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787834112.853959:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787834112.853965:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df6067d4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834112.853975:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 583 00000100:00080000:3.0:1787834112.853983:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787834112.854011:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df6067d4000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834112.854096:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e121e00 x1874679406226688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787834112.854165:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406226688:0@lo:38:kworker.0 00000400:00000100:1.0:1787834112.854220:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406226688 offset 0 length 520: 4 00000100:00100000:2.0:1787834112.854520:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406226816:0@lo:400:kworker.0 00000400:00000100:2.0:1787834112.854548:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406226816 offset 0 length 224: 4 00000100:00080000:3.0:1787834112.854830:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787834112.854834:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787834112.854836:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df502ccb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834112.854840:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 583 00000100:00080000:3.0:1787834112.854844:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787834112.854848:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df502ccb800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834112.854873:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e1221c0 x1874679406226944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787834112.854929:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406227072:0@lo:400:kworker.0 00000400:00000100:2.0:1787834112.854951:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406227072 offset 0 length 224: 4 00000100:00100000:1.0:1787834112.855047:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406226944:0@lo:38:kworker.0 00000400:00000100:1.0:1787834112.855070:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406226944 offset 0 length 520: 4 00000020:01000004:2.0:1787834113.076608:0:21116:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787834113.087746:0:21116:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787834113.088095:0:21116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834113.088111:0:21116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834113.088119:0:21116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834113.088126:0:21116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834113.088182:0:21116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787834113.088188:0:21116:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787834113.088214:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787834113.088226:0:21116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df60e121e00 x1874679406226688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787834127 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834113.088248:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787834113.088254:0:21116:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787834113.088275:0:21116:0:(import.c:65:import_set_state_nolock()) ffff8df6067d4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787834113.088281:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787834113.088285:0:21116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df60e121e00 x1874679406226688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787834127 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834113.088292:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787834113.088295:0:21116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:2.0:1787834113.088332:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834113.088340:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834113.088348:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834113.088351:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834113.088361:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834113.088368:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834113.088373:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787834113.088376:0:17130:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787834113.088378:0:17130:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787834113.088392:0:17130:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df61e603000 00010000:00010000:2.0:1787834113.088396:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834113.088412:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504677800/0x996d2fb20dc1e67a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e681 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834113.088423:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834113.088425:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834113.088426:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834113.088541:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406226688:0@lo:38:kworker.0 00000100:00080000:0.0:1787834113.092315:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787834113.092334:0:21116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df60e1203c0 x1874679406226816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834128 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834113.092360:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787834113.092365:0:21116:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787834113.092388:0:21116:0:(import.c:65:import_set_state_nolock()) ffff8df60343d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787834113.092628:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406227200:0@lo:39:umount.0 00000400:00000100:1.0:1787834113.092690:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406227200 offset 0 length 224: 4 00000100:00100000:2.0:1787834113.092800:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406226816:0@lo:400:kworker.0 00010000:00010000:0.0:1787834113.813940:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834114.838373:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787834114.906414:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787834114.906422:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834114.906425:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787834114.906428:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787834114.906714:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406227328:0@lo:400:kworker.0 00000400:00000100:2.0:1787834114.906789:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406227328 offset 0 length 224: 4 00000001:00100000:0.0:1787834114.910636:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787834114.910659:0:18644:0:(genops.c:885:class_export_put()) final put ffff8df6065e5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787834114.911370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df6065e5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787834114.911439:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df6065e1000 for lustre-OST0000 00000001:00100000:2.0:1787834114.915142:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787834114.915151:0:19463:0:(genops.c:885:class_export_put()) final put ffff8df60345d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787834114.915219:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60345d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787834114.915275:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df60345f000 for lustre-OST0001 00010000:00010000:2.0:1787834115.862028:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834116.885934:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834117.910076:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787834117.910159:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787834117.910165:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834117.910168:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787834117.910171:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787834117.910301:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787834117.910328:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406227456:0@lo:400:kworker.0 00000400:00000100:3.0:1787834117.910380:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406227456 offset 0 length 224: 4 00010000:00010000:2.0:1787834118.935145:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834119.253882:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834109/real 1787834109] req@ffff8df60e120000 x1874679406226560/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787834119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834119.253918:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df60e120000 x1874679406226560/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787834119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787834119.253940:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61e603000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834119.253989:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787834119.253994:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3637:1874679406226560:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1787834119.254078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787834119.254084:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787834119.254087:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df61e603000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834119.254092:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 585 00000100:00080000:0.0:1787834119.254097:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.117@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787834119.254103:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.117@tcp: import ffff8df61e603000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834119.254130:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6359d8780 x1874679406227584/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787834119.254162:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787834119.254171:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787834119.254242:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406227712:0@lo:400:kworker.0 00000400:00000100:3.0:1787834119.254287:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406227712 offset 0 length 224: 4 00000100:00100000:2.0:1787834119.254494:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3637:1874679406227584:0@lo:250:kworker.0 00000400:00000100:2.0:1787834119.254526:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874679406227584 offset 0 length 520: 4 00010000:00010000:0.0:1787834119.960160:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834120.982159:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834122.006190:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834123.029916:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834123.353393:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834113/real 1787834113] req@ffff8df6359da940 x1874679406227200/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787834123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834123.353439:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df6359da940 x1874679406227200/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787834123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787834123.353461:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df60343d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787834123.353488:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406227200:0@lo:39:umount.0 00000100:00080000:0.0:1787834123.353584:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787834123.353589:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787834123.353594:0:21116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787834123.354566:0:21116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834123.354582:0:21116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834123.354589:0:21116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834123.354596:0:21116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834123.354625:0:21116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787834123.354632:0:21116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834123.354639:0:21116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834123.354645:0:21116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834123.354650:0:21116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834123.354684:0:21116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787834123.354689:0:21116:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787834123.354715:0:21116:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787834123.354719:0:21116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787834123.354725:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787834123.354730:0:21116:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787834123.354734:0:21116:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8df635429a48) has no exports 00000020:00080000:0.0:1787834123.354797:0:21116:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8df635429a48) has no exports 00010000:00010000:2.0:1787834123.356125:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834123.356138:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834123.356149:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834123.356154:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834123.356163:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834123.356183:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834123.356190:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787834123.356192:0:17130:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787834123.356195:0:17130:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787834123.356425:0:17130:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df61e603000 00010000:00010000:2.0:1787834123.356431:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834123.356438:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df600031000/0x996d2fb20dc1e650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e657 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834123.356479:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834123.356483:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834123.356489:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834123.356492:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834123.356499:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834123.356505:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834123.356510:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787834123.356512:0:17130:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787834123.356514:0:17130:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787834123.356523:0:17130:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df61e603000 00010000:00010000:2.0:1787834123.356525:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834123.356530:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df503c3b400/0x996d2fb20dc1e9a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e9ad expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834123.356538:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834123.356539:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834123.356541:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834123.356958:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787834123.359455:0:21116:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df503cef240 - data ffff8df5028cc948/ffff8df503e87800 00000020:01000000:0.0:1787834123.359623:0:21116:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df504ce0960 - data ffff8df62edb0870/ffff8df6068ee000 00100000:10000000:2.0:1787834123.372294:0:21116:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787834123.397027:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e665 00000020:00000080:0.0:1787834123.397041:0:21116:0:(genops.c:885:class_export_put()) final put ffff8df503f61000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787834123.397052:0:21116:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63435b800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787834123.397056:0:21116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63435b800 2 00000020:01000004:0.0:1787834123.397059:0:21116:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df63435b800 from lustre-OST0000 00000020:00000080:0.0:1787834123.397082:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787834123.397092:0:21116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787834123.397094:0:21116:0:(genops.c:885:class_export_put()) final put ffff8df62ea22800/lustre-OST0000_UUID 00000020:00000080:0.0:1787834123.397097:0:21116:0:(genops.c:844:class_export_destroy()) destroying export ffff8df62ea22800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787834123.397107:0:21116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787834123.397159:0:21116:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787834123.397163:0:21116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787834123.397167:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787834123.397172:0:21116:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787834123.397179:0:21116:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8df503f63800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787834123.397185:0:21116:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8df63542b490) has exports, disconnecting them 00000020:00080000:0.0:1787834123.397189:0:21116:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8df503f63800), last request at 1787834044 00000020:00000080:0.0:1787834123.397193:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e68f 00000020:00080000:0.0:1787834123.397225:0:21116:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df503f63800): rc 0 00000020:00000080:0.0:1787834123.397230:0:21116:0:(genops.c:885:class_export_put()) final put ffff8df503f63800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787834123.398164:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f61000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787834123.398182:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f63800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787834123.398207:0:21116:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787834123.398222:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787834123.398226:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787834123.398230:0:21116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787834123.398403:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787834123.398410:0:21116:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787834123.398420:0:21116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787834123.398424:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787834123.398427:0:21116:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787834123.398432:0:21116:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8df6187e7800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787834123.398438:0:21116:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8df5039b9a48) has exports, disconnecting them 00000020:00080000:1.0:1787834123.398441:0:21116:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8df6187e7800), last request at 1787834044 00000020:00000080:1.0:1787834123.398444:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e6a4 00000020:00080000:1.0:1787834123.398458:0:21116:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df6187e7800): rc 0 00000020:00000080:1.0:1787834123.398462:0:21116:0:(genops.c:885:class_export_put()) final put ffff8df6187e7800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787834123.398546:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df6067d4000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787834123.398556:0:8:0:(genops.c:885:class_export_put()) final put ffff8df503f62000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787834123.398559:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f62000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787834123.398566:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787834123.398626:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df6187e7800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787834123.408002:0:21116:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787834123.408011:0:21116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787834123.408015:0:21116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787834123.408022:0:21116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787834123.408058:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df60343d800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787834123.408234:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787834123.408243:0:21116:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787834123.408249:0:21116:0:(genops.c:885:class_export_put()) final put ffff8df60343b000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787834123.408253:0:21116:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60343b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787834123.408257:0:21116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787834123.408318:0:21116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63435b800 1 00000020:00000080:3.0:1787834123.408323:0:21116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e642 00000020:00000080:3.0:1787834123.408329:0:21116:0:(genops.c:885:class_export_put()) final put ffff8df60665d000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787834123.408336:0:21116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787834123.408354:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8df60665d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787834123.408365:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787834123.408370:0:21116:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787834123.408373:0:21116:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8df60346b490) has no exports 00000020:00000080:3.0:1787834123.429149:0:21116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787834123.429165:0:21116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787834123.429170:0:21116:0:(genops.c:885:class_export_put()) final put ffff8df63435d800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787834123.429175:0:21116:0:(genops.c:844:class_export_destroy()) destroying export ffff8df63435d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787834123.429184:0:21116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787834123.429297:0:21116:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df63435a800 00000020:02000400:3.0:1787834123.429540:0:21116:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787834124.057922:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787834124.629874:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787834124.629884:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834124.629888:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787834124.629891:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787834124.633641:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787834124.633667:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406227840:0@lo:400:kworker.0 00000400:00000100:3.0:1787834124.633722:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406227840 offset 0 length 224: 4 00010000:00010000:2.0:1787834125.078939:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834126.105856:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787834126.949556:0:21318:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787834126.968913:0:21318:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787834126.969007:0:21318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834126.969022:0:21318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834126.969046:0:21318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834126.969053:0:21318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834126.969119:0:21318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787834126.969124:0:21318:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787834126.969153:0:21318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787834126.969163:0:21318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df60e1221c0 x1874679406226944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787834127 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834126.969189:0:21318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787834126.969194:0:21318:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787834126.969200:0:21318:0:(import.c:65:import_set_state_nolock()) ffff8df502ccb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787834126.969204:0:21318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787834126.969208:0:21318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df60e1221c0 x1874679406226944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787834127 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834126.969215:0:21318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787834126.969218:0:21318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:1.0:1787834126.972215:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406226944:0@lo:38:kworker.0 00000100:00080000:3.0:1787834126.973181:0:21318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787834126.973195:0:21318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df60e120f00 x1874679406227072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834128 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834126.973212:0:21318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df636ad6d00 x1874679406227328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834130 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834126.973237:0:21318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df50568f480 x1874679406227456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834133 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834126.973245:0:21318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6359db0c0 x1874679406227712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834135 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834126.973279:0:21318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df6359dad00 x1874679406227840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834140 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834126.973287:0:21318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1787834126.973317:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406227840:0@lo:400:kworker.0 00000100:00100000:3.0:1787834126.973325:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406227712:0@lo:400:kworker.0 00000100:00080000:3.0:1787834126.973355:0:21318:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787834126.973380:0:21318:0:(import.c:65:import_set_state_nolock()) ffff8df502ccb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787834126.973536:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406227456:0@lo:400:kworker.0 00000100:00100000:2.0:1787834126.973544:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406227328:0@lo:400:kworker.0 00000100:00100000:1.0:1787834126.973627:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874679406227072:0@lo:400:kworker.0 00000100:00100000:1.0:1787834126.973653:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406227968:0@lo:39:umount.0 00000400:00000100:1.0:1787834126.973699:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679406227968 offset 0 length 224: 4 00010000:00010000:0.0:1787834126.974464:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834126.974475:0:19480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834126.974486:0:19480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834126.974490:0:19480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834126.974500:0:19480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834126.974507:0:19480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834126.974513:0:19480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787834126.974515:0:19480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787834126.974519:0:19480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787834126.974536:0:19480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df61e603000 00010000:00010000:0.0:1787834126.974540:0:19480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834126.974547:0:19480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504676800/0x996d2fb20dc1e714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e71b expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834126.974578:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834126.974580:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834126.974581:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834127.126001:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834128.152984:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834129.173907:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787834129.749959:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787834129.749970:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787834130.198076:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834131.221991:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834132.246144:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834133.272962:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834134.165902:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834119/real 1787834119] req@ffff8df6359d8780 x1874679406227584/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787834134 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834134.165935:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df6359d8780 x1874679406227584/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787834134 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787834134.165957:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61e603000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834134.165984:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787834134.165989:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3637:1874679406227584:0@lo:250:kworker.0 00000100:00080000:3.0:1787834134.166040:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787834134.166047:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787834134.166050:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df61e603000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834134.166055:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 595 00000100:00080000:3.0:1787834134.166060:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.117@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787834134.166067:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.117@tcp: import ffff8df61e603000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834134.166102:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e123c00 x1874679406228096/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787834134.166265:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3637:1874679406228096:0@lo:250:kworker.0 00000400:00000100:2.0:1787834134.166311:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874679406228096 offset 0 length 520: 4 00010000:00010000:3.0:1787834134.294131:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834135.318723:0:19480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834136.214173:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834126/real 1787834126] req@ffff8df60e1230c0 x1874679406227968/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787834136 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834136.214206:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df60e1230c0 x1874679406227968/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787834136 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787834136.214227:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502ccb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787834136.214247:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406227968:0@lo:39:umount.0 00000100:00080000:3.0:1787834136.214668:0:21318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787834136.214675:0:21318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787834136.214680:0:21318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787834136.216231:0:21318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834136.216251:0:21318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834136.216273:0:21318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834136.216280:0:21318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834136.216308:0:21318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834136.216318:0:21318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834136.216324:0:21318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834136.216331:0:21318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834136.216337:0:21318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834136.216414:0:21318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787834136.216420:0:21318:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787834136.216457:0:21318:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787834136.216461:0:21318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787834136.216474:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787834136.216479:0:21318:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787834136.216483:0:21318:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8df62ea91a48) has no exports 00000020:00080000:3.0:1787834136.216583:0:21318:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8df62ea91a48) has no exports 00000020:01000000:3.0:1787834136.224290:0:21318:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df503cef900 - data ffff8df62eececa8/ffff8df503e86000 00010000:00010000:0.0:1787834136.225705:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787834136.225721:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834136.225733:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834136.225738:0:17129:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834136.225761:0:17129:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834136.225769:0:17129:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834136.225776:0:17129:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787834136.225779:0:17129:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787834136.225782:0:17129:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787834136.225800:0:17129:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df61e603000 00010000:00010000:0.0:1787834136.225805:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834136.225813:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df620723200/0x996d2fb20dc1e6ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e6f1 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834136.225981:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834136.225985:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834136.225991:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677a00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834136.225995:0:17129:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834136.226002:0:17129:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834136.226008:0:17129:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834136.226013:0:17129:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787834136.226015:0:17129:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787834136.226017:0:17129:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787834136.226023:0:17129:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df61e603000 00010000:00010000:0.0:1787834136.226026:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834136.226032:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504677a00/0x996d2fb20dc1e998 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e99f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834136.226044:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834136.226046:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834136.226048:0:17129:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834136.226958:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787834136.227125:0:21318:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8df6114ca240 - data ffff8df6122ab000/ffff8df6068eec00 00100000:10000000:3.0:1787834136.234059:0:21318:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787834136.251394:0:21318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e6ff 00000020:00000080:2.0:1787834136.251408:0:21318:0:(genops.c:885:class_export_put()) final put ffff8df50474a000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787834136.251467:0:21318:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df63a82c000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787834136.251472:0:21318:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63a82c000 2 00000020:01000004:2.0:1787834136.251475:0:21318:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8df63a82c000 from lustre-OST0001 00000020:00000080:2.0:1787834136.251509:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787834136.251531:0:21318:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787834136.251535:0:21318:0:(genops.c:885:class_export_put()) final put ffff8df504748000/lustre-OST0001_UUID 00000020:00000080:2.0:1787834136.251538:0:21318:0:(genops.c:844:class_export_destroy()) destroying export ffff8df504748000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787834136.251544:0:21318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787834136.251661:0:21318:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1a2d970c-4ae1-4256-8fee-b2c6594a1c06->MGS 00010000:00010000:2.0:1787834136.251676:0:21318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e515 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834136.251700:0:21318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e515 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834136.251707:0:21318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787834136.251710:0:21318:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787834136.251713:0:21318:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787834136.251726:0:21318:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df61e603000 00010000:00010000:2.0:1787834136.251730:0:21318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df620723400/0x996d2fb20dc1e50e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e515 expref: -99 pid: 17873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834136.251743:0:21318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834136.251768:0:21318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834136.251774:0:21318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787834136.251776:0:21318:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787834136.251787:0:21318:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787834136.251801:0:21318:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8df61e603000 00010000:00010000:2.0:1787834136.251804:0:21318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df620723c00/0x996d2fb20dc1e3fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x996d2fb20dc1e404 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787834136.251822:0:21318:0:(import.c:65:import_set_state_nolock()) ffff8df61e603000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787834136.251826:0:21318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787834136.251828:0:21318:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787834136.251829:0:21318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787834136.251833:0:21318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787834136.251844:0:21318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8df60e123c00 x1874679406228096/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787834154 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787834136.251865:0:21318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787834136.251868:0:21318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:3.0:1787834136.251955:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1a2d970c-4ae1-4256-8fee-b2c6594a1c06:3637:1874679406228096:0@lo:250:kworker.0 10000000:01000000:2.0:1787834136.251997:0:21318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787834136.252004:0:21318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e3e8 00000020:00000080:2.0:1787834136.252009:0:21318:0:(genops.c:885:class_export_put()) final put ffff8df61e607800/1a2d970c-4ae1-4256-8fee-b2c6594a1c06 00000020:00000080:0.0:1787834136.252047:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df50474a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787834136.252134:0:21318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.117@tcp (flags='') 00000020:00000080:2.0:1787834136.252273:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e607800/1a2d970c-4ae1-4256-8fee-b2c6594a1c06 for MGC192.168.203.117@tcp 00000020:00000080:2.0:1787834136.252291:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787834136.252296:0:21318:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.117@tcp: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787834136.252300:0:21318:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8df503f10000) has no exports 10000000:01000000:0.0:1787834136.252735:0:17138:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787834136.252879:0:21318:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.117@tcp: client import never connected 00000100:00080000:2.0:1787834136.252883:0:21318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787834136.252886:0:21318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787834136.252888:0:21318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787834136.252890:0:21318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787834136.252937:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787834136.252942:0:21318:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.117@tcp (uuid 1a2d970c-4ae1-4256-8fee-b2c6594a1c06) 00000020:01000000:2.0:1787834136.252949:0:21318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787834136.252952:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787834136.252956:0:21318:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787834136.252967:0:21318:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8df502cc9000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787834136.252973:0:21318:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8df60346ced8) has exports, disconnecting them 00000020:00080000:2.0:1787834136.252977:0:21318:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8df502cc9000), last request at 1787834059 00000020:00000080:2.0:1787834136.252981:0:21318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e729 00000020:00080000:2.0:1787834136.252993:0:21318:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df502cc9000): rc 0 00000020:00000080:2.0:1787834136.252997:0:21318:0:(genops.c:885:class_export_put()) final put ffff8df502cc9000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787834136.253645:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df61e603000 for MGC192.168.203.117@tcp 00000020:00000080:3.0:1787834136.253662:0:37:0:(genops.c:885:class_export_put()) final put ffff8df61e606800/1a2d970c-4ae1-4256-8fee-b2c6594a1c06 00000020:00000080:3.0:1787834136.253665:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df61e606800/1a2d970c-4ae1-4256-8fee-b2c6594a1c06 for MGC192.168.203.117@tcp 00000020:01000000:3.0:1787834136.253676:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.117@tcp (1a2d970c-4ae1-4256-8fee-b2c6594a1c06) 00000020:00000080:3.0:1787834136.253969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502cc9000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787834136.257913:0:21318:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787834136.257922:0:21318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787834136.257927:0:21318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787834136.257933:0:21318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787834136.258149:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787834136.258157:0:21318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787834136.258163:0:21318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787834136.258170:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787834136.258175:0:21318:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787834136.258182:0:21318:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8df502cc8000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787834136.258189:0:21318:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8df603469a48) has exports, disconnecting them 00000020:00080000:3.0:1787834136.258194:0:21318:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8df502cc8000), last request at 1787834059 00000020:00000080:3.0:1787834136.258198:0:21318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e73e 00000020:00080000:3.0:1787834136.258214:0:21318:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8df502cc8000): rc 0 00000020:00000080:3.0:1787834136.258218:0:21318:0:(genops.c:885:class_export_put()) final put ffff8df502cc8000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1787834136.258917:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502ccb800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787834136.258928:0:37:0:(genops.c:885:class_export_put()) final put ffff8df5039ec000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787834136.258931:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039ec000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787834136.258937:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787834136.259000:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502cc8000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787834136.273129:0:21318:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787834136.273139:0:21318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787834136.273144:0:21318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787834136.273151:0:21318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787834136.273193:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8df502ccb000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1787834136.273253:0:19480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787834136.273380:0:17129:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787834136.277232:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787834136.277374:0:17125:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8df50250c600:17125] 1 exiting: rc = 0 00000100:00100000:2.0:1787834136.277420:0:17124:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8df50250ca00:17124] 0 exiting: rc = 1 00000100:00100000:0.0:1787834136.277454:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.277736:0:17128:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8df503efbe00:17128] 2 exiting: rc = 0 00000100:00100000:2.0:1787834136.283729:0:17126:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8df50250de00:17126] 0 exiting: rc = 1 00000100:00100000:1.0:1787834136.286102:0:18674:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8df503fa7000:18674] 3 exiting: rc = 0 00000100:00100000:0.0:1787834136.291533:0:17127:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8df63434c800:17127] 1 exiting: rc = 0 00000100:00100000:0.0:1787834136.291657:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291665:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291672:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291677:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291683:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291701:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291707:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291712:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291717:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291723:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291729:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291734:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291739:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291744:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291763:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291788:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291793:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291797:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291802:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291806:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291811:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291816:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291821:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291826:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291832:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291837:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291842:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291847:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.291852:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294079:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294102:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294107:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294112:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294116:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294121:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294126:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294132:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294137:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294143:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294149:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294153:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294158:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294162:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294166:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294171:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294176:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294717:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294725:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294730:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294735:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294774:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294781:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294787:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294794:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294800:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294807:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294814:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294821:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294830:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294837:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294848:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.294856:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.295418:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.296145:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787834136.302954:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787834136.302969:0:21318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787834136.302976:0:21318:0:(genops.c:885:class_export_put()) final put ffff8df502ccc000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787834136.302980:0:21318:0:(genops.c:844:class_export_destroy()) destroying export ffff8df502ccc000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787834136.302988:0:21318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787834136.303038:0:21318:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df63a82c000 1 00000020:00000080:0.0:1787834136.303043:0:21318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x996d2fb20dc1e6e3 00000020:00000080:0.0:1787834136.303048:0:21318:0:(genops.c:885:class_export_put()) final put ffff8df503f60800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787834136.303059:0:21318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787834136.303069:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8df503f60800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787834136.303080:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787834136.303085:0:21318:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787834136.303089:0:21318:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8df603468000) has no exports 00000020:00000080:0.0:1787834136.465378:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787834136.465394:0:21318:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787834136.465400:0:21318:0:(genops.c:885:class_export_put()) final put ffff8df5039ef000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787834136.465405:0:21318:0:(genops.c:844:class_export_destroy()) destroying export ffff8df5039ef000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787834136.465418:0:21318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787834136.472953:0:21318:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8df5039ea000 00000020:01000000:0.0:1787834136.473001:0:21318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787834136.473006:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787834136.473012:0:21318:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787834136.473017:0:21318:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8df62ea93490) has no exports 00000020:00000080:0.0:1787834136.473039:0:21318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787834136.473048:0:21318:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787834136.473053:0:21318:0:(genops.c:885:class_export_put()) final put ffff8df606658800/OSS_uuid 00000020:00000080:0.0:1787834136.473056:0:21318:0:(genops.c:844:class_export_destroy()) destroying export ffff8df606658800/OSS_uuid for OSS 00000020:01000000:0.0:1787834136.473061:0:21318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787834136.473161:0:18648:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8df635b88600:18648] 0 exiting: rc = 1 00000100:00100000:0.0:1787834136.473259:0:19578:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8df503e80400:19578] 4 exiting: rc = 0 00000100:00100000:1.0:1787834136.473395:0:19277:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8df606687a00:19277] 3 exiting: rc = 0 00000100:00100000:1.0:1787834136.473459:0:18650:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8df632a8e400:18650] 2 exiting: rc = 0 00000100:00080000:3.0:1787834136.473615:0:17137:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787834136.473741:0:18649:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8df6030adc00:18649] 1 exiting: rc = 0 00000100:00100000:0.0:1787834136.478865:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478875:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478881:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478887:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478892:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478897:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478903:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478908:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478913:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478919:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478925:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478930:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478936:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478942:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478947:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478953:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478958:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478964:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478970:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478975:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478981:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478987:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478992:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.478997:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479014:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479019:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479024:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479030:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479035:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479040:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479046:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479051:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479056:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479062:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479067:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479072:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479077:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479083:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479088:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479093:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479098:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479103:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479110:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479115:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479121:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479126:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479131:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479136:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479142:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479147:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479152:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479158:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479163:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479168:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479173:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479178:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479183:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479189:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479193:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479206:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479212:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479217:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479222:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.479227:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.495639:0:18652:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8df63b2d1200:18652] 1 exiting: rc = 0 00000100:00100000:3.0:1787834136.495783:0:18651:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8df63c1eda00:18651] 0 exiting: rc = 1 00000100:00100000:3.0:1787834136.499891:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499914:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499920:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499925:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499930:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499935:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499941:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499945:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499950:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499954:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499959:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499964:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499969:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499974:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499978:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499983:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499988:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499993:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.499998:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500003:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500008:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500013:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500017:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500022:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500026:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500031:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500036:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500040:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500045:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500049:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500054:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500059:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500064:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500068:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500073:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500079:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500088:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500093:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500099:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500104:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500110:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500115:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500120:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500125:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500130:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500134:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500139:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500143:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500148:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500153:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500158:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500163:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500168:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500173:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500177:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500182:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500187:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500191:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500196:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500200:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500204:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500209:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500214:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.500225:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.501294:0:18654:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8df63b17b200:18654] 1 exiting: rc = 0 00000100:00100000:3.0:1787834136.501551:0:20283:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8df502ce9600:20283] 3 exiting: rc = 0 00000100:00100000:3.0:1787834136.501858:0:18653:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8df63b17ac00:18653] 0 exiting: rc = 1 00000100:00100000:3.0:1787834136.502066:0:18655:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8df63b074800:18655] 2 exiting: rc = 0 00000100:00100000:3.0:1787834136.502131:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502138:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502157:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502163:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502168:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502174:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502180:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502186:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502193:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502199:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502205:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502210:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502216:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502222:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502229:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502235:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502252:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502259:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502264:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502270:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502276:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502281:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502287:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502293:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502299:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502304:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502310:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502315:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502321:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502326:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502332:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502337:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502344:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502349:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502355:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502361:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502368:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502379:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502385:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502391:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502409:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502415:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502421:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502427:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502432:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502437:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502443:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502449:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502455:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502460:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502466:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502472:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502478:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502483:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502488:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502493:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502498:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502504:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502515:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502522:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502527:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502533:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502545:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787834136.502551:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787834136.514952:0:18656:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8df503864400:18656] 0 exiting: rc = 1 00000100:00100000:3.0:1787834136.517067:0:18657:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8df608fc1200:18657] 1 exiting: rc = 0 00000100:00100000:0.0:1787834136.520902:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520912:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520918:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520923:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520929:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520936:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520942:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520947:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520952:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520957:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520963:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520968:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520974:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520979:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520984:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520989:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.520994:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521000:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521005:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521011:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521017:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521024:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521030:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521036:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521042:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521047:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521052:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521058:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521063:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521069:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521095:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521100:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521105:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521111:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521117:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521122:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521128:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521133:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521138:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521143:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521149:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521154:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521159:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521165:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521170:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521175:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521181:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521186:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521192:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521197:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521203:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521208:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521214:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521219:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521225:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521230:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521235:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521240:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521245:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521251:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521255:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521260:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521265:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.521270:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787834136.522182:0:18658:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8df6066ff000:18658] 0 exiting: rc = 1 00000100:00100000:1.0:1787834136.525941:0:18659:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8df6066ff800:18659] 1 exiting: rc = 0 00000100:00100000:0.0:1787834136.526147:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526168:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526174:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526180:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526187:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526217:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526224:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526230:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526237:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526244:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526250:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526256:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526261:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526269:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526277:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526285:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526291:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526313:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526320:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526326:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526332:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526338:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526343:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526349:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526355:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526360:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526365:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526371:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526378:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526398:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526405:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526412:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526417:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526424:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526431:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526437:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526452:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526458:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526463:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526469:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526474:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526495:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526501:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526507:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526512:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526518:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526525:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526530:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526535:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526540:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526545:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526551:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526556:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526573:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526579:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526584:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526589:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526594:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526599:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526605:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526610:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526616:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526621:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787834136.526634:0:21318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787834136.535805:0:21318:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787834154.949405:0:22083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787834166.162504:0:22683:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787834166.162511:0:22683:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787834166.162512:0:22683:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787834166.162799:0:22683:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df60ed4e000 00000020:01000004:1.0:1787834166.162819:0:22683:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787834166.162826:0:22683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787834166.162839:0:22683:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8df603468000) 00000020:00000080:1.0:1787834166.162852:0:22683:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787834166.300665:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787834166.302888:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787834166.317647:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787834166.319531:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.319770:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.320055:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.320406:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.321003:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.321262:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.322570:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.323319:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.324570:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.326510:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.327002:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.327568:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.328082:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.328406:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.328669:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.329091:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.329356:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.329612:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.330107:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.330395:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.330584:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.331013:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.331542:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.331816:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.332131:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.332362:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.332607:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.332907:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.333797:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787834166.334176:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.334428:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787834166.337826:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787834166.346236:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787834166.346528:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787834166.347110:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787834166.347382:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787834166.347665:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787834166.348312:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787834166.348578:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787834166.348966:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787834166.349393:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787834166.349986:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787834166.350319:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787834166.351177:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787834166.361891:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1787834166.362457:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787834166.362671:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787834166.363402:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787834166.363652:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787834166.364443:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:0.0:1787834166.369139:0:22683:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787834166.369333:0:22683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787834166.369340:0:22683:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787834166.369350:0:22683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ec54 00000020:01000004:0.0:1787834166.369358:0:22683:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787834166.369363:0:22683:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787834166.369367:0:22683:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df60ed4e000 from MGS 00000020:01000004:0.0:1787834166.369371:0:22683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787834166.369380:0:22683:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8df635429a48) 00000020:00000080:0.0:1787834166.369390:0:22683:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787834166.369448:0:22683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df60ed4e000 from MGS, refs=2 00080000:01000000:0.0:1787834166.369453:0:22683:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787834166.369458:0:22683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ec62 00000100:00100000:0.0:1787834166.369563:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787834166.369677:0:22683:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787834166.369682:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787834166.372585:0:22683:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787834166.372596:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787834166.373286:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834166.373575:0:22683:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787834166.373581:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787834166.374103:0:22683:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787834166.374110:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787834166.374494:0:22683:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787834166.374501:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787834166.379054:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834166.379059:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834166.379061:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834166.379437:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834166.379440:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834166.379441:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834166.380051:0:22683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787834166.382706:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787834166.389302:0:22683:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787834166.396348:0:22696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787834166.397233:0:22683:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787834166.397300:0:22683:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787834166.402440:0:22683:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787834166.408976:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787834166.411276:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787834166.411285:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787834166.416400:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787834166.416413:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787834166.422628:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787834166.422646:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1787834166.428309:0:22701:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787834166.428527:0:22683:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787834166.428549:0:22683:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.117@tcp' 00000020:01000004:2.0:1787834166.428550:0:22683:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787834166.428579:0:22683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.117@tcp (typ=mgc) 00000020:00000080:2.0:1787834166.428591:0:22683:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.117@tcp (ffff8df62ea91a48) 00000020:00000080:2.0:1787834166.428607:0:22683:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787834166.428684:0:22683:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df504d9f000@MGC192.168.203.117@tcp: add connection 192.168.203.117@tcp at head 00010000:00010000:2.0:1787834166.430306:0:22683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.117@tcp-0 is initialized 00000040:01000000:2.0:1787834166.430316:0:22683:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787834166.448881:0:22703:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787834166.451498:0:22683:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.117@tcp (uuid e9903e54-1448-45ce-bd63-f50f2c84e331) 00000020:00000080:1.0:1787834166.451529:0:22683:0:(genops.c:1385:class_connect()) connect: client e9903e54-1448-45ce-bd63-f50f2c84e331, cookie 0x996d2fb20dc1ec70 00000100:00080000:1.0:1787834166.451542:0:22683:0:(import.c:510:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834166.451549:0:22683:0:(import.c:624:import_select_connection()) MGC192.168.203.117@tcp: import ffff8df504d9f000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834166.451583:0:22683:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df636ad70c0 x1874679406228224/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834166.451616:0:22683:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e9903e54-1448-45ce-bd63-f50f2c84e331->MGS 00000020:01000004:1.0:1787834166.451639:0:22683:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787834166.451644:0:22683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787834166.451658:0:22683:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8df603469a48) 00000020:00000080:1.0:1787834166.451669:0:22683:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787834166.454843:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9903e54-1448-45ce-bd63-f50f2c84e331:3637:1874679406228224:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787834166.454922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834166.454988:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406228224 00000100:00100000:2.0:1787834166.454996:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406228224 00000100:00100000:2.0:1787834166.455022:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787834166.455029:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1874679406228224:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787834166.455053:0:22698:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from e9903e54-1448-45ce-bd63-f50f2c84e331@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:2.0:1787834166.455081:0:22698:0:(genops.c:1385:class_connect()) connect: client e9903e54-1448-45ce-bd63-f50f2c84e331, cookie 0x996d2fb20dc1ec7e 00000100:00080000:2.0:1787834166.455211:0:22698:0:(import.c:65:import_set_state_nolock()) ffff8df504d98800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834166.455260:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+5:3637:x1874679406228224:12345-0@lo:250:mount.lustre.0 Request processed in 229us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834166.455267:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787834166.455307:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787834166.455314:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.117@tcp: connect to target with instance 0 00000100:00080000:2.0:1787834166.455321:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787834166.455336:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787834166.455339:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df504d9f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787834166.455352:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787834166.455360:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787834166.455365:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9903e54-1448-45ce-bd63-f50f2c84e331:3637:1874679406228224:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787834166.470214:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787834166.470403:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787834166.470409:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787834166.479451:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787834166.479463:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787834166.480324:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787834166.480339:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787834166.481177:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787834166.481367:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787834166.481373:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787834166.482307:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787834166.482315:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787834166.543615:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787834166.544517:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787834166.544526:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787834166.547057:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787834166.547074:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787834166.554139:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787834166.555156:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787834166.555173:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787834166.560339:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787834166.560352:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787834166.560979:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834166.561142:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787834166.561147:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787834166.562290:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787834166.562299:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787834166.563113:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787834166.563349:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787834166.563354:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787834166.570427:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787834166.570439:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787834166.610303:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787834166.611893:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787834166.611904:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787834166.625024:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787834166.625042:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787834166.627015:0:22683:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787834166.627028:0:22683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787834166.629126:0:22683:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787834166.629156:0:22683:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787834166.629163:0:22683:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787834166.629261:0:22683:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787834166.629295:0:22683:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787834166.629299:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787834166.629300:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787834166.629302:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834166.629303:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834166.629304:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834166.629306:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834166.629307:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787834166.629308:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787834166.629310:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834166.629311:0:22683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787834166.629314:0:22683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787834166.629315:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787834166.629317:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787834166.629317:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834166.629319:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834166.629320:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834166.629321:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834166.629327:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787834166.629328:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787834166.629329:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834166.629330:0:22683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787834166.629355:0:22683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787834166.629373:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228352:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787834166.629447:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834166.629493:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df501084b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787834166.629558:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406228352 00000100:00100000:0.0:1787834166.629565:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406228352 00000100:00100000:0.0:1787834166.629607:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787834166.629617:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+5:22683:x1874679406228352:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787834166.629661:0:22700:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787834166.629664:0:22700:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787834166.629667:0:22700:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787834166.630085:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787834166.630587:0:22700:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1787834166.636059:0:22721:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787834166.636068:0:22721:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787834166.636071:0:22721:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787834166.636073:0:22721:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787834166.636431:0:22721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787834166.636665:0:22700:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787834166.636676:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787834166.638690:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+5:22683:x1874679406228352:12345-0@lo:253:mount.lustre.0 Request processed in 9067us (9235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834166.638703:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787834166.638898:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228352:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787834166.638912:0:22683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787834166.638915:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787834166.638916:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787834166.638918:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834166.638919:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834166.638920:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834166.638921:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834166.638922:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787834166.638923:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787834166.638925:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834166.638927:0:22683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787834166.638945:0:22683:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df60ed4e000 from lustre-MDT0000 10000000:01000000:2.0:1787834166.638974:0:22683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787834166.638977:0:22683:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787834166.638981:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8df62ea91a48 10000000:01000000:2.0:1787834166.638985:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787834166.638992:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8df62ea91a48 from 1 10000000:01000000:2.0:1787834166.638995:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787834166.639031:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834166.639042:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834166.639051:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834166.639077:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834166.639114:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834166.639152:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5010840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834166.639360:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406228480 00000100:00100000:0.0:1787834166.639365:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406228480 00000100:00100000:0.0:1787834166.639406:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787834166.639416:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+5:22683:x1874679406228480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834166.639428:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834166.639443:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676800/0x996d2fb20dc1ec8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ec85 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.639464:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676800/0x996d2fb20dc1ec8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ec85 expref: 6 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.639491:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676800/0x996d2fb20dc1ec8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ec85 expref: 6 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.639500:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676800, rc 0) 00000100:00100000:0.0:1787834166.639541:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+6:22683:x1874679406228480:12345-0@lo:101:mount.lustre.0 Request processed in 127us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834166.639548:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787834166.639658:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834166.639671:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.639680:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834166.639779:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834166.639805:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.639831:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605130480 going to sleep for 11 seconds 00000100:00100000:0.0:1787834166.640177:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406228608 00000100:00100000:0.0:1787834166.640182:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406228608 00000100:00100000:0.0:1787834166.640217:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787834166.640224:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+6:22683:x1874679406228608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834166.640301:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+6:22683:x1874679406228608:12345-0@lo:501:mount.lustre.0 Request processed in 78us (494us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787834166.640308:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787834166.640449:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228608:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787834166.640486:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787834166.640506:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.640515:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834166.640529:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df60ed4e000 10000000:01000000:3.0:1787834166.640534:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787834166.640538:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df60ed4e000 10000000:01000000:3.0:1787834166.640541:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787834166.640544:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df60ed4e000 from 1 10000000:01000000:3.0:1787834166.640546:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787834166.640564:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1ec93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.640572:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1ec93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.640580:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1ec93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834166.640592:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228736:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787834166.640619:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.640641:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605130480 going to sleep for 11 seconds 00000100:00100000:1.0:1787834166.640685:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406228736 00000100:00100000:1.0:1787834166.640689:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406228736 00000100:00100000:1.0:1787834166.640728:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787834166.640736:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+6:22683:x1874679406228736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834166.640743:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834166.640775:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1ec9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ec93 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.640791:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1ec9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ec93 expref: 7 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.640799:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3a600/0x996d2fb20dc1ec9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ec93 expref: 7 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.640806:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3a600, rc 0) 00000100:00100000:1.0:1787834166.640832:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+7:22683:x1874679406228736:12345-0@lo:101:mount.lustre.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834166.640838:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787834166.641433:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228736:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834166.641446:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1ec93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec9a expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.641454:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1ec93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ec9a expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834166.641466:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787834166.641470:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1ec93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec9a expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.641498:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b7c00/0x996d2fb20dc1ec93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec9a expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834166.641505:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787834166.641509:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787834166.641514:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df60ed4e000 10000000:01000000:3.0:1787834166.641516:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787834166.641518:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787834166.641521:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787834166.641538:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7800/0x996d2fb20dc1eca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.641544:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b7800/0x996d2fb20dc1eca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.641551:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b7800/0x996d2fb20dc1eca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834166.641564:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787834166.641594:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.641623:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605130480 going to sleep for 11 seconds 00000100:00100000:1.0:1787834166.641667:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406228864 00000100:00100000:1.0:1787834166.641672:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406228864 00000100:00100000:1.0:1787834166.641707:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834166.641723:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+7:22683:x1874679406228864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834166.641731:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834166.641746:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3ac00/0x996d2fb20dc1eca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1eca1 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.641787:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3ac00/0x996d2fb20dc1eca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1eca1 expref: 8 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.641796:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3ac00/0x996d2fb20dc1eca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1eca1 expref: 8 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.641802:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ac00, rc 0) 00000100:00100000:1.0:1787834166.641837:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+8:22683:x1874679406228864:12345-0@lo:101:mount.lustre.0 Request processed in 123us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834166.641843:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787834166.642150:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834166.642161:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b7800/0x996d2fb20dc1eca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eca8 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.642168:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7800/0x996d2fb20dc1eca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1eca8 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834166.642223:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834166.642249:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.642274:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605130480 going to sleep for 11 seconds 00000100:00100000:1.0:1787834166.642399:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406228992 00000100:00100000:1.0:1787834166.642403:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406228992 00000100:00100000:1.0:1787834166.642434:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787834166.642442:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+8:22683:x1874679406228992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834166.642571:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+9:22683:x1874679406228992:12345-0@lo:501:mount.lustre.0 Request processed in 129us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834166.642579:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787834166.644089:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406228992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834166.644138:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406229120:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834166.644196:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.644236:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df605130480 going to sleep for 11 seconds 00000100:00100000:0.0:1787834166.647843:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406229120 00000100:00100000:0.0:1787834166.647856:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406229120 00000100:00100000:0.0:1787834166.647931:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787834166.647941:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+9:22683:x1874679406229120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834166.656033:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+9:22683:x1874679406229120:12345-0@lo:503:mount.lustre.0 Request processed in 8084us (11828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834166.656048:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787834166.656225:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406229120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834166.656690:0:22722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22722:1874679406229248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787834166.656739:0:22722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834166.656826:0:22722:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df603907780 going to sleep for 11 seconds 00000100:00100000:0.0:1787834166.657053:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406229248 00000100:00100000:0.0:1787834166.657059:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406229248 00000100:00100000:0.0:1787834166.657103:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787834166.657112:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+9:22722:x1874679406229248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787834166.659555:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+9:22722:x1874679406229248:12345-0@lo:502:llog_process_th.0 Request processed in 2437us (2809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834166.659577:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787834166.659691:0:22722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22722:1874679406229248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787834166.659724:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834166.659735:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834166.659738:0:22722:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787834166.659742:0:22722:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787834166.659789:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834166.659804:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8df60346ced8) 00000020:00000080:1.0:1787834166.659822:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787834166.659828:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787834166.659912:0:22722:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787834166.659920:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ecb6 00000020:00000080:1.0:1787834166.660116:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787834166.660121:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834166.660124:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834166.660126:0:22722:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787834166.660128:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834166.660132:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834166.660133:0:22722:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787834166.660136:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834166.660142:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8df60346b490) 00000020:00000080:1.0:1787834166.660151:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787834166.660155:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787834166.660157:0:22722:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787834166.660160:0:22722:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787834166.660165:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787834166.660204:0:22722:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df60ed4e000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787834166.660216:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8df634431a48) 00000020:00000080:1.0:1787834166.660224:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787834166.660282:0:22722:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787834166.660290:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1eccb 00000020:00000080:1.0:1787834166.660385:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787834166.660391:0:22722:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787834166.660395:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x996d2fb20dc1ecd2 00080000:01000000:1.0:1787834166.660400:0:22722:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787834166.660403:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ecd9 00010000:00010000:3.0:1787834166.796017:0:22722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787834166.796682:0:22722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1787834166.797156:0:22722:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787834166.798637:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8df5039b9a48) 00000020:00000080:3.0:1787834166.798656:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787834166.798778:0:22722:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787834166.798786:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ece7 00000020:00000080:0.0:1787834166.799403:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787834166.813370:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x996d2fb20dc1ecee 00000020:00000080:1.0:1787834166.815130:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787834166.815141:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834166.815147:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834166.815158:0:22722:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787834166.815161:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787834166.815164:0:22722:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787834166.815166:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834166.815167:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834166.815169:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787834166.815172:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834166.815173:0:22722:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787834166.815176:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834166.815191:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834166.815193:0:22722:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787834166.815197:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787834166.815241:0:22722:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787834166.815255:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834166.815259:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834166.815260:0:22722:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787834166.815263:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834166.815266:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834166.815267:0:22722:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787834166.815270:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787834166.815275:0:22722:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:00000080:1.0:1787834166.815301:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834166.815317:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8df634430000) 00000020:00000080:1.0:1787834166.815345:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787834166.815351:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787834166.815416:0:22722:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787834166.815422:0:22722:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787834166.815429:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ecfc 00010000:00080000:1.0:1787834166.815459:0:22722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df61e602800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834166.821563:0:22722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787834166.834231:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787834166.834245:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787834166.834284:0:22722:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787834166.834304:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1ed03 00000100:00080000:3.0:1787834166.834314:0:22722:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787834166.834328:0:22722:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df61e602800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834166.834362:0:22722:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e123480 x1874679406229376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834166.834389:0:22722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787834166.834461:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834166.834465:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.834467:0:22722:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787834166.834470:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787834166.834484:0:22722:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787834166.834486:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787834166.834487:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787834166.834489:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787834166.834492:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.834493:0:22722:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787834166.834496:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787834166.834501:0:22722:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787834166.834503:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.834505:0:22722:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787834166.834508:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787834166.834511:0:22722:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:3.0:1787834166.834533:0:22722:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787834166.834537:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787834166.834550:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8df5039bb490) 00000020:00000080:3.0:1787834166.834560:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787834166.834564:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787834166.834624:0:22722:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787834166.834631:0:22722:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787834166.834636:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ed11 00010000:00080000:3.0:1787834166.834665:0:22722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df504686000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.117@tcp at head 00000100:00100000:2.0:1787834166.835098:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406229376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787834166.835162:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834166.835258:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406229376 00000100:00100000:0.0:1787834166.835266:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406229376 00000100:00100000:0.0:1787834166.835301:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787834166.835309:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406229376:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787834166.835324:0:22709:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:3.0:1787834166.838459:0:22722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787834166.842554:0:22722:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787834166.843469:0:22722:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787834166.860614:0:22722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787834166.862175:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1787834166.870280:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:1.0:1787834166.874182:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406229376:12345-0@lo:38:llog_process_th.0 Request processed in 38864us (39011us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787834166.874234:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787834166.874770:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61e602800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787834166.874777:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787834166.874781:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406229376:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787834166.883369:0:22728:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787834166.883377:0:22728:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787834166.884839:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787834166.884852:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787834166.884890:0:22722:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787834166.884909:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1ed18 00000100:00080000:2.0:1787834166.884919:0:22722:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787834166.884925:0:22722:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df504686000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834166.884958:0:22722:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50568c3c0 x1874679406229504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787834166.885031:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406229504:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787834166.885084:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406229504 offset 0 length 520: 4 00000100:00080000:2.0:1787834166.885140:0:22722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787834166.885217:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834166.885223:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834166.885225:0:22722:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787834166.885228:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787834166.885230:0:22722:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1787834166.885232:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787834166.885233:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787834166.885234:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787834166.885237:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834166.885238:0:22722:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787834166.885240:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787834166.885244:0:22722:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787834166.885247:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834166.885249:0:22722:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787834166.885261:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787834166.885265:0:22722:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:2.0:1787834166.885298:0:22722:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787834166.885301:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787834166.885313:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8df62ea90000) 00000020:00000080:2.0:1787834166.885946:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787834166.885956:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787834166.886082:0:22722:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787834166.886088:0:22722:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787834166.886094:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x996d2fb20dc1ed26 00010000:00080000:2.0:1787834166.886137:0:22722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df620728000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:2.0:1787834166.886690:0:22722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787834166.886951:0:22722:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787834166.886969:0:22722:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787834166.897006:0:22722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834166.898880:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787834166.899574:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1787834166.900217:0:22730:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787834166.900222:0:22730:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787834166.901930:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787834166.901943:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787834166.901981:0:22722:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787834166.902001:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1ed2d 00000100:00080000:2.0:1787834166.902020:0:22722:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787834166.902027:0:22722:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df620728000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834166.902074:0:22722:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50568f480 x1874679406229632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787834166.902093:0:22722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787834166.902145:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834166.902150:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834166.902157:0:22722:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787834166.902161:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834166.902166:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834166.902168:0:22722:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787834166.902171:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787834166.902173:0:22722:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787834166.902175:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834166.902177:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834166.902178:0:22722:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787834166.902181:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834166.902183:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834166.902184:0:22722:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787834166.902188:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787834166.902229:0:22722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22722:1874679406229760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787834166.902301:0:22722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834166.902628:0:22722:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787834166.902701:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406229760 00000100:00100000:0.0:1787834166.902709:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406229760 00000100:00100000:0.0:1787834166.902776:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787834166.902787:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+9:22722:x1874679406229760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787834166.902901:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+9:22722:x1874679406229760:12345-0@lo:502:llog_process_th.0 Request processed in 115us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834166.902908:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787834166.902949:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406229632:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787834166.902972:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406229632 offset 0 length 520: 4 00000100:00100000:2.0:1787834166.906837:0:22722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22722:1874679406229760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787834166.906882:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834166.906892:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834166.906894:0:22722:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787834166.906898:0:22722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787834166.907348:0:22683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787834166.907369:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787834166.907392:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7800/0x996d2fb20dc1eca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eca8 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.907413:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b7800/0x996d2fb20dc1eca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eca8 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834166.907422:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60ed4e000 from 1 10000000:01000000:0.0:1787834166.907424:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787834166.907458:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.907466:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.907483:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834166.907503:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406229888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787834166.907572:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834166.907613:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c346c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834166.907852:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406229888 00000100:00100000:1.0:1787834166.907858:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406229888 00000100:00100000:1.0:1787834166.907893:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787834166.907901:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+9:22683:x1874679406229888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834166.907914:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834166.907927:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ed34 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.907948:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed34 expref: 10 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.907958:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed34 expref: 10 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.907967:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b000, rc 0) 00000100:00100000:1.0:1787834166.908012:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+10:22683:x1874679406229888:12345-0@lo:101:mount.lustre.0 Request processed in 111us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834166.908019:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787834166.908102:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406229888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834166.908115:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.908124:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834166.908865:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230016:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787834166.908923:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.908951:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df632a36600 going to sleep for 11 seconds 00000100:00100000:2.0:1787834166.909036:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406230016 00000100:00100000:2.0:1787834166.909042:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406230016 00000100:00100000:2.0:1787834166.909068:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787834166.909075:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+10:22683:x1874679406230016:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787834166.909090:0:22699:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787834166.909095:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787834166.909164:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+10:22683:x1874679406230016:12345-0@lo:256:mount.lustre.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834166.909172:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787834166.913127:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230016:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787834166.913863:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787834166.913882:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.913892:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834166.913901:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df60ed4e000 from 1 10000000:01000000:3.0:1787834166.913904:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787834166.913942:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.913950:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.913960:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834166.913994:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787834166.914052:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.914146:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df632a36600 going to sleep for 11 seconds 00000100:00100000:1.0:1787834166.915747:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406230144 00000100:00100000:1.0:1787834166.915780:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406230144 00000100:00100000:1.0:1787834166.915971:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787834166.915981:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+10:22683:x1874679406230144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834166.915997:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834166.916025:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ed42 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.916049:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed42 expref: 11 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.916070:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed42 expref: 11 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834166.916079:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b400, rc 0) 00000100:00100000:1.0:1787834166.916147:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22683:x1874679406230144:12345-0@lo:101:mount.lustre.0 Request processed in 168us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834166.916154:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787834166.916245:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834166.916261:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.916270:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834166.916343:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834166.916374:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.917242:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df632a36600 going to sleep for 11 seconds 00000100:00100000:0.0:1787834166.917401:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406230272 00000100:00100000:0.0:1787834166.917408:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406230272 00000100:00100000:0.0:1787834166.917441:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787834166.917449:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22683:x1874679406230272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834166.919456:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22683:x1874679406230272:12345-0@lo:501:mount.lustre.0 Request processed in 2000us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834166.919468:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787834166.919805:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834166.919857:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834166.919919:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.919956:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df632a36600 going to sleep for 11 seconds 00000100:00100000:0.0:1787834166.920077:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406230400 00000100:00100000:0.0:1787834166.920083:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406230400 00000100:00100000:0.0:1787834166.920162:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834166.920171:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22683:x1874679406230400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834166.920293:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22683:x1874679406230400:12345-0@lo:503:mount.lustre.0 Request processed in 123us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834166.920301:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834166.920516:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834166.921098:0:22732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22732:1874679406230528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.921137:0:22732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.921170:0:22732:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df632a36540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834166.921313:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406230528 00000100:00100000:0.0:1787834166.921318:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406230528 00000100:00100000:0.0:1787834166.921361:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787834166.921368:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22732:x1874679406230528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787834166.921958:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22732:x1874679406230528:12345-0@lo:502:llog_process_th.0 Request processed in 589us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834166.921966:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787834166.922104:0:22732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22732:1874679406230528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787834166.922127:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834166.922141:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.922143:0:22732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787834166.922149:0:22732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df60ed4e000 00000020:00000080:3.0:1787834166.922152:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834166.922160:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834166.922162:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.922164:0:22732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787834166.922166:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834166.922169:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.922170:0:22732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787834166.922173:0:22732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df60ed4e000 00000020:00000080:3.0:1787834166.922175:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834166.922298:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834166.922301:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.922303:0:22732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787834166.922305:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834166.922307:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.922309:0:22732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834166.922312:0:22732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df60ed4e000 00000020:00000080:3.0:1787834166.922314:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834166.922340:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834166.922343:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.922344:0:22732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834166.922346:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834166.922348:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.922350:0:22732:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787834166.922353:0:22732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df60ed4e000 00000020:00000080:3.0:1787834166.922355:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787834166.922393:0:22732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22732:1874679406230656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.922431:0:22732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.922460:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406230656 00000100:00100000:3.0:1787834166.922465:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406230656 00000100:00100000:3.0:1787834166.922501:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787834166.922514:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22732:x1874679406230656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.922740:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22732:x1874679406230656:12345-0@lo:502:llog_process_th.0 Request processed in 227us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.922747:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787834166.922810:0:22732:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df632a36540 going to sleep for 11 seconds 00000100:00100000:3.0:1787834166.922823:0:22732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22732:1874679406230656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787834166.922839:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834166.922844:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834166.922845:0:22732:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787834166.922849:0:22732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787834166.930883:0:22683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787834166.930918:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787834166.930945:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834166.930956:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834166.931008:0:22683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787834166.931021:0:22683:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df60ed4e000 10000000:01000000:2.0:1787834166.931024:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df60ed4e000 10000000:01000000:2.0:1787834166.931029:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787834166.931034:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df60ed4e000 from 1 10000000:01000000:2.0:1787834166.931037:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787834166.931070:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1ed50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834166.931078:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1ed50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834166.931090:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1ed50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834166.931112:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834166.931173:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834166.931219:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99540 going to sleep for 11 seconds 00000100:00100000:3.0:1787834166.931799:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406230784 00000100:00100000:3.0:1787834166.931807:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406230784 00000100:00100000:3.0:1787834166.931853:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787834166.931863:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22683:x1874679406230784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834166.931876:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834166.931891:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6a00/0x996d2fb20dc1ed57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ed50 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.931915:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6a00/0x996d2fb20dc1ed57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed50 expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.931925:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6a00/0x996d2fb20dc1ed57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed50 expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.931933:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6a00, rc 0) 00000100:00100000:3.0:1787834166.931985:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22683:x1874679406230784:12345-0@lo:101:mount.lustre.0 Request processed in 124us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.931993:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787834166.932153:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834166.932168:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1ed50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed57 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834166.932187:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1ed50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ed57 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834166.932258:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834166.932287:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834166.932415:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99540 going to sleep for 11 seconds 00000100:00100000:3.0:1787834166.933111:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406230912 00000100:00100000:3.0:1787834166.933118:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406230912 00000100:00100000:3.0:1787834166.933150:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787834166.933158:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22683:x1874679406230912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834166.933287:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22683:x1874679406230912:12345-0@lo:501:mount.lustre.0 Request processed in 130us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.933294:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787834166.933463:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406230912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834166.933510:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406231040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834166.934660:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834166.934690:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99540 going to sleep for 11 seconds 00000100:00100000:3.0:1787834166.935719:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406231040 00000100:00100000:3.0:1787834166.935729:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406231040 00000100:00100000:3.0:1787834166.935787:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787834166.935796:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22683:x1874679406231040:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834166.935919:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22683:x1874679406231040:12345-0@lo:503:mount.lustre.0 Request processed in 124us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.935927:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787834166.936095:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406231040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834166.945850:0:22735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22735:1874679406231168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.945947:0:22735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.945986:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406231168 00000100:00100000:3.0:1787834166.945991:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406231168 00000100:00100000:3.0:1787834166.946041:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787834166.946050:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22735:x1874679406231168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.946162:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22735:x1874679406231168:12345-0@lo:502:llog_process_th.0 Request processed in 112us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.946170:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787834166.946226:0:22735:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df632a36180 going to sleep for 11 seconds 00000100:00100000:3.0:1787834166.946246:0:22735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22735:1874679406231168:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787834166.946302:0:22735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787834166.946769:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8df5039bced8) 00000020:00000080:3.0:1787834166.946791:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787834166.946865:0:22735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df60ed4e000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787834166.946869:0:22735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df60ed4e000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787834166.946872:0:22735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df60ed4e000 4 00010000:00080000:3.0:1787834166.946898:0:22735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df62ea7e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1787834166.953689:0:22735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787834166.953982:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787834166.955970:0:22735:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787834166.955988:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x996d2fb20dc1ed65 00000100:00080000:3.0:1787834166.955999:0:22735:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787834166.956005:0:22735:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df62ea7e800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834166.956047:0:22735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e121680 x1874679406231296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834166.956075:0:22735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787834166.957155:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406231296:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787834166.957237:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834166.959006:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406231296 00000100:00100000:0.0:1787834166.959428:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406231296 00000100:00100000:0.0:1787834166.959482:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787834166.959490:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e122940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406231296:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787834166.960101:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e122940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406231296:12345-0@lo:38:llog_process_th.0 Request processed in 609us (2861us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787834166.960109:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834166.960449:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787834166.960458:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df62ea7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787834166.960462:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787834166.960465:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406231296:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787834166.970336:0:22735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22735:1874679406231424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.970415:0:22735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.970452:0:22735:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df611df8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787834166.970471:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406231424 00000100:00100000:3.0:1787834166.970732:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406231424 00000100:00100000:3.0:1787834166.974791:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787834166.974808:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22735:x1874679406231424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.975252:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22735:x1874679406231424:12345-0@lo:502:llog_process_th.0 Request processed in 445us (4836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.975260:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787834166.975332:0:22735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22735:1874679406231424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.975391:0:22735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22735:1874679406231552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.975450:0:22735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.975487:0:22735:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df632a36180 going to sleep for 11 seconds 00000100:00100000:3.0:1787834166.975501:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406231552 00000100:00100000:3.0:1787834166.975506:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406231552 00000100:00100000:3.0:1787834166.975531:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787834166.975537:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22735:x1874679406231552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787834166.975600:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22735:x1874679406231552:12345-0@lo:502:llog_process_th.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.975607:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787834166.975641:0:22735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9903e54-1448-45ce-bd63-f50f2c84e331:22735:1874679406231552:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787834166.975658:0:22735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787834166.976980:0:22683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787834166.977603:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787834166.977629:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1ed50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed57 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834166.977642:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4fa00/0x996d2fb20dc1ed50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed57 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787834166.977691:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787834166.977694:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787834166.977695:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834166.977696:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834166.977698:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834166.977699:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834166.977700:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787834166.977702:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787834166.977707:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834166.977709:0:22683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787834166.977712:0:22683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787834166.977714:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787834166.977715:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787834166.977716:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834166.977717:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834166.977718:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834166.977719:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834166.977720:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787834166.977721:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787834166.977722:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834166.977723:0:22683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787834166.977781:0:22683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787834166.977798:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406231680:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787834166.977853:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834166.980002:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787834166.980018:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406231680 00000100:00100000:3.0:1787834166.980027:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406231680 00000100:00100000:3.0:1787834166.980074:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787834166.980083:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22683:x1874679406231680:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787834166.980111:0:22700:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787834166.980123:0:22700:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787834166.983630:0:22700:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787834166.983649:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787834166.984086:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22683:x1874679406231680:12345-0@lo:253:mount.lustre.0 Request processed in 4000us (6228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.984098:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:0.0:1787834166.984595:0:22720:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787834166.984600:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787834166.984618:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.984633:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed34 expref: 11 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.984641:0:22720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.984686:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ed34 expref: 11 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.984699:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed34 expref: 11 pid: 22700 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834166.984713:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406231808:0@lo:104: 00000100:00100000:0.0:1787834166.984767:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834166.984802:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787834166.985003:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406231808 00000100:00100000:3.0:1787834166.985010:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406231808 00000100:00100000:3.0:1787834166.985062:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834166.985070:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406231808:12345-0@lo:104: 00010000:00010000:3.0:1787834166.985082:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.985133:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787834166.985139:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406231808:12345-0@lo:104: Request processed in 71us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.985144:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787834166.985883:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834166.985890:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.985899:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834166.985903:0:22694:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.985912:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834166.985919:0:22694:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834166.985925:0:22694:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787834166.985957:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.985965:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787834166.985984:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.985998:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504677600/0x996d2fb20dc1ed34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ed3b expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.986023:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834166.986026:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834166.986027:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834166.986060:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406231936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834166.986098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834166.986158:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406231936 00000100:00100000:0.0:1787834166.986161:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406231808:0@lo:104: 00000100:00100000:3.0:1787834166.986163:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406231936 00010000:00010000:0.0:1787834166.986180:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986181:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed34 expref: 12 pid: 22700 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834166.986201:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834166.986208:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:3640:x1874679406231936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834166.986218:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834166.986223:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed34 expref: 12 pid: 22700 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986233:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed34 expref: 12 pid: 22700 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986245:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ed3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ed34 expref: 12 pid: 22700 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986264:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986272:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787834166.986285:0:22690:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001685391s 00010000:00010000:3.0:1787834166.986290:0:22690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986296:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986302:0:22690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986307:0:22690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986312:0:22690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834166.986329:0:22690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986336:0:22690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986352:0:22690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834166.986360:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834166.986397:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+11:3640:x1874679406231936:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834166.986404:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834166.986435:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406231936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834166.986625:0:22720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.986633:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834166.986639:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504677200/0x996d2fb20dc1ed6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834166.987838:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:22683:1874679406231680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787834166.987853:0:22683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787834166.987856:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787834166.987858:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787834166.987870:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834166.987871:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834166.987872:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834166.987874:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834166.987875:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787834166.987876:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787834166.987878:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834166.987880:0:22683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787834166.987892:0:22683:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1787834167.016231:0:22683:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1787834167.016878:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787834167.016964:0:22744:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1787834167.016968:0:22744:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1787834167.026782:0:22745:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787834167.028224:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1787834167.030365:0:22745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1787834167.031936:0:22746:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8df636ad4780 x1874679406232064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834167.031951:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00000040:01000000:2.0:1787834167.032399:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787834167.032447:0:22683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787834167.032883:0:22683:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787834167.032890:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787834167.032924:0:22683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834167.033857:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787834167.034400:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787834167.034433:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787834167.039552:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787834167.039644:0:22745:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1787834167.041894:0:22683:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1787834167.042886:0:22683:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1787834167.049364:0:22683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787834167.051453:0:22683:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787834167.051499:0:22683:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9fc9c182f988 00100000:10000000:3.0:1787834167.051506:0:22683:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787834167.052733:0:22683:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787834167.052772:0:22683:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787834167.052789:0:22683:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787834167.052805:0:22683:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787834167.053723:0:22683:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834167.054043:0:22683:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787834167.447533:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787834168.029233:0:22740:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787834168.029242:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787834168.032903:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787834168.032918:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1787834168.086220:0:22703:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787834168.086227:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60ed4e000 from 11 10000000:01000000:0.0:1787834168.086231:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787834168.086270:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834168.086282:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834168.086299:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834168.086331:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406232192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787834168.086391:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834168.086431:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787834168.086632:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406232192 00000100:00100000:3.0:1787834168.086639:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406232192 00000100:00100000:3.0:1787834168.086686:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787834168.086694:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+11:22703:x1874679406232192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834168.086706:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834168.086717:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ed73 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834168.086738:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed73 expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834168.086901:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed73 expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834168.086918:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7200, rc 0) 00000100:00100000:3.0:1787834168.086966:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22703:x1874679406232192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834168.086973:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787834168.088151:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406232192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834168.088170:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834168.088180:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834168.088240:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406232320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787834168.088286:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834168.088510:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787834168.088529:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406232320 00000100:00100000:0.0:1787834168.088534:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406232320 00000100:00100000:0.0:1787834168.088568:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787834168.088575:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22703:x1874679406232320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787834168.088590:0:22700:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787834168.088604:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787834168.088607:0:22700:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787834168.088678:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:22703:x1874679406232320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834168.088686:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787834168.088722:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406232320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787834168.089175:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787834168.089184:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834168.089193:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834168.096286:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787834168.471023:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787834169.045899:0:22740:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787834169.045907:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787834169.046018:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1787834169.046055:0:22740:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787834169.046283:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1787834169.110275:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787834169.494010:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834170.134384:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787834170.520012:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834171.170112:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:1.0:1787834171.542125:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787834172.065366:0:22988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787834172.185834:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00000100:00080000:2.0:1787834172.246207:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787834172.246213:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787834172.246217:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df61e602800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787834172.246225:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:2.0:1787834172.246230:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787834172.246236:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df61e602800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834172.246260:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50568c000 x1874679406232576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787834172.246277:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834172.246281:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834172.246284:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834172.246286:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834172.246299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787834172.246302:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787834172.246304:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df62ea7e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787834172.246310:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8df62ea7e800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834172.246324:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50568e1c0 x1874679406232704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787834172.246349:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406232576:0@lo:38:kworker.0 00000100:00100000:2.0:1787834172.246425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834172.246563:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406232448:0@lo:400:kworker.0 00000100:00100000:1.0:1787834172.246600:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834172.246703:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406232704:0@lo:38:kworker.0 00000100:00100000:2.0:1787834172.246734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834172.246933:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406232576 00000100:00100000:1.0:1787834172.246940:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406232576 00000100:00100000:1.0:1787834172.246977:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787834172.246985:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874679406232576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787834172.247003:0:22710:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787834172.247043:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874679406232576:12345-0@lo:38:kworker.0 Request processed in 57us (618us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787834172.247050:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787834172.247190:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406232448 00000100:00100000:0.0:1787834172.247194:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406232448 00000100:00100000:0.0:1787834172.247263:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787834172.247271:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:3641:x1874679406232448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834172.247312:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:3641:x1874679406232448:12345-0@lo:400:kworker.0 Request processed in 43us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834172.247319:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787834172.247388:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406232448:0@lo:400:kworker.0 00000100:00080000:2.0:1787834172.247552:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61e602800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834172.247558:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787834172.247562:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406232576:0@lo:38:kworker.0 00000100:00100000:2.0:1787834172.249839:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406232704 00000100:00100000:2.0:1787834172.249853:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406232704 00000100:00100000:2.0:1787834172.249889:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787834172.249897:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406232704:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787834172.249925:0:22706:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:2.0:1787834172.249961:0:22706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x996d2fb20dc1ed81 00000004:00100000:2.0:1787834172.249978:0:22706:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787834172.250111:0:22706:0:(import.c:65:import_set_state_nolock()) ffff8df63a8b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834172.250198:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874679406232704:12345-0@lo:38:kworker.0 Request processed in 300us (3461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834172.250205:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787834172.250368:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df50568e1c0 x1874679406232704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787834172.250385:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787834172.252661:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787834172.252673:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787834172.252678:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df62ea7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787834172.252690:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874679406232704:0@lo:38:kworker.0 00010000:00010000:0.0:1787834172.577236:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787834172.979667:0:23040:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787834172.979978:0:23040:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787834173.205970:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:1.0:1787834173.589951:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787834173.743313:0:23091:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787834173.743803:0:23091:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787834174.229876:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787834174.614070:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834175.254523:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787834175.638934:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834176.278184:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00000100:00100000:2.0:1787834176.341871:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834166/real 1787834166] req@ffff8df50568f480 x1874679406229632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834176.341909:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df50568f480 x1874679406229632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834176.341920:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834166/real 1787834166] req@ffff8df50568c3c0 x1874679406229504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834176.341931:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df50568c3c0 x1874679406229504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787834176.341950:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df620728000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834176.341970:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787834176.341974:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406229632:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787834176.341979:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df504686000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834176.341984:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787834176.341986:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406229504:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787834176.342084:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787834176.342089:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787834176.342092:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df61e602800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834176.342098:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1787834176.342103:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787834176.342110:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df61e602800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834176.342137:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6359d9680 x1874679406232960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787834176.342152:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834176.342155:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787834176.342157:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df504686000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834176.342160:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:0.0:1787834176.342163:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787834176.342167:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df504686000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834176.342178:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6359d9a40 x1874679406233088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787834176.342185:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834176.342188:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787834176.342189:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df620728000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834176.342192:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:0.0:1787834176.342194:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787834176.342196:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df620728000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834176.342205:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6359d8f00 x1874679406233216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787834176.342234:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406232960:0@lo:38:kworker.0 00000100:00100000:0.0:1787834176.342346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834176.342387:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406233088:0@lo:8:kworker.0 00000400:00000100:0.0:1787834176.342405:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406233088 offset 0 length 520: 4 00000100:00100000:0.0:1787834176.342433:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406233216:0@lo:8:kworker.0 00000400:00000100:0.0:1787834176.342448:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406233216 offset 0 length 520: 4 00000100:00100000:2.0:1787834176.342532:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406233344:0@lo:400:kworker.0 00000100:00100000:2.0:1787834176.342588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834176.342616:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787834176.342622:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9903e54-1448-45ce-bd63-f50f2c84e331:3639:1874679406232832:0@lo:400:kworker.0 00000100:00100000:2.0:1787834176.342647:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834176.342676:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406232832 00000100:00100000:2.0:1787834176.342682:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406232832 00000100:00100000:2.0:1787834176.342724:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787834176.342732:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:3639:x1874679406232832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834176.342807:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:3639:x1874679406232832:12345-0@lo:400:kworker.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834176.342820:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787834176.342864:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9903e54-1448-45ce-bd63-f50f2c84e331:3639:1874679406232832:0@lo:400:kworker.0 00000100:00100000:0.0:1787834176.343004:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406233344 00000100:00100000:0.0:1787834176.343009:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406233344 00000100:00100000:0.0:1787834176.343040:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787834176.343048:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406233344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834176.343086:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406233344:12345-0@lo:400:kworker.0 Request processed in 39us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834176.343091:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787834176.343124:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df6359d83c0 x1874679406233344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834176.343135:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406233344:0@lo:400:kworker.0 00000100:00100000:1.0:1787834176.343369:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406232960 00000100:00100000:1.0:1787834176.343373:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406232960 00000100:00100000:1.0:1787834176.343401:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787834176.343406:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874679406232960:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787834176.343852:0:22710:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787834176.344118:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874679406232960:12345-0@lo:38:kworker.0 Request processed in 709us (1770us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787834176.344127:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787834176.347175:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61e602800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787834176.347187:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787834176.347192:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406232960:0@lo:38:kworker.0 00010000:00010000:3.0:1787834176.665099:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834177.303508:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787834177.688298:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834178.325869:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787834178.712974:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787834179.288833:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787834179.353865:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:1.0:1787834179.734322:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787834180.146825:0:23435:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787834180.146829:0:23435:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787834180.146830:0:23435:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787834180.146951:0:23435:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df503c53800 00000020:01000004:1.0:1787834180.146969:0:23435:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787834180.146982:0:23435:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787834180.146997:0:23435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8df634434ed8) 00000020:00000080:1.0:1787834180.147013:0:23435:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787834180.215934:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787834180.216810:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787834180.221992:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787834180.222889:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787834180.223167:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787834180.223703:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787834180.224131:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787834180.224565:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787834180.224874:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787834180.225440:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787834180.225881:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787834180.226216:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787834180.226528:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787834180.226878:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787834180.228193:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.229112:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.229444:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.229899:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.230178:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.230481:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.230684:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.231186:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.231507:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.231682:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.232013:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.232289:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.232567:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.232899:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.233293:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.233608:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.233896:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.234518:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.234831:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.235019:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.235287:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.235624:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.236084:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.236320:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.237098:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.237593:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.238042:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787834180.238281:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787834180.238607:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787834180.239163:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787834180.239698:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787834180.240227:0:23435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00080000:01000000:2.0:1787834180.241981:0:23435:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787834180.242393:0:23435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787834180.242406:0:23435:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787834180.242417:0:23435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1ed8f 00000020:01000004:2.0:1787834180.242424:0:23435:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787834180.242447:0:23435:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787834180.242451:0:23435:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787834180.242456:0:23435:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787834180.242603:0:23435:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787834180.242608:0:23435:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787834180.253450:0:23435:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787834180.253492:0:23435:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.117@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1787834180.253498:0:23435:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787834180.253500:0:23435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787834180.253501:0:23435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834180.253502:0:23435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834180.253503:0:23435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834180.253504:0:23435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834180.253506:0:23435:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787834180.253508:0:23435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834180.253509:0:23435:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787834180.253513:0:23435:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1787834180.253516:0:23435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787834180.253517:0:23435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787834180.253518:0:23435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834180.253525:0:23435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834180.253526:0:23435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834180.253527:0:23435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834180.253527:0:23435:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787834180.253528:0:23435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834180.253529:0:23435:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787834180.253557:0:23435:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787834180.253575:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233472:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787834180.253989:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.254092:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50480 going to sleep for 11 seconds 00000100:00100000:2.0:1787834180.254142:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406233472 00000100:00100000:2.0:1787834180.254150:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406233472 00000100:00100000:2.0:1787834180.254249:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787834180.254260:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:23435:x1874679406233472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787834180.254294:0:22700:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787834180.254297:0:22700:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787834180.254305:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787834180.254673:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+12:23435:x1874679406233472:12345-0@lo:253:mount.lustre.0 Request processed in 413us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.254682:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787834180.254788:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233472:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787834180.254799:0:23435:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787834180.254812:0:23435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787834180.254814:0:23435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787834180.254815:0:23435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834180.254816:0:23435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834180.254817:0:23435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834180.254818:0:23435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834180.254819:0:23435:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787834180.254821:0:23435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834180.254822:0:23435:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787834180.254853:0:23435:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df503c53800 from lustre-MDT0001 10000000:01000000:2.0:1787834180.254885:0:23435:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787834180.254889:0:23435:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787834180.254895:0:23435:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df62ea91a48 local copy 00010000:00010000:2.0:1787834180.254907:0:23435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834180.255015:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834180.255051:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834180.256077:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63436d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787834180.256134:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406233600 00000100:00100000:0.0:1787834180.256141:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406233600 00000100:00100000:0.0:1787834180.256181:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787834180.256189:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:23435:x1874679406233600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834180.256329:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:23435:x1874679406233600:12345-0@lo:501:mount.lustre.0 Request processed in 140us (1277us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787834180.256337:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787834180.256465:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233600:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787834180.256485:0:23435:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787834180.256508:0:23435:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787834180.256516:0:23435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.256526:0:23435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834180.256551:0:23435:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df503c53800 10000000:01000000:2.0:1787834180.256556:0:23435:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787834180.256562:0:23435:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8df62ea91a48 10000000:01000000:2.0:1787834180.256578:0:23435:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787834180.256582:0:23435:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8df62ea91a48 from 1 10000000:01000000:2.0:1787834180.256585:0:23435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787834180.256612:0:23435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f200/0x996d2fb20dc1ed96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.256620:0:23435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4f200/0x996d2fb20dc1ed96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.256629:0:23435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4f200/0x996d2fb20dc1ed96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834180.256645:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834180.256676:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834180.256885:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63436d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.257045:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406233728 00000100:00100000:3.0:1787834180.257051:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406233728 00000100:00100000:0.0:1787834180.257093:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787834180.257101:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+12:23435:x1874679406233728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834180.257110:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834180.257124:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504677a00/0x996d2fb20dc1ed9d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ed96 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.257144:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677a00/0x996d2fb20dc1ed9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed96 expref: 13 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.257154:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504677a00/0x996d2fb20dc1ed9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed96 expref: 13 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.257162:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677a00, rc 0) 00000100:00100000:0.0:1787834180.257212:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+13:23435:x1874679406233728:12345-0@lo:101:mount.lustre.0 Request processed in 111us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834180.257218:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787834180.257359:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834180.257372:0:23435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4f200/0x996d2fb20dc1ed96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed9d expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.257380:0:23435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4f200/0x996d2fb20dc1ed96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ed9d expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834180.257405:0:23435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787834180.257422:0:23435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f200/0x996d2fb20dc1ed96 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed9d expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.257429:0:23435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4f200/0x996d2fb20dc1ed96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ed9d expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834180.257438:0:23435:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8df503c53800 10000000:01000000:2.0:1787834180.257447:0:23435:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787834180.257450:0:23435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8df503c53800 from 1 10000000:01000000:2.0:1787834180.257453:0:23435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787834180.257470:0:23435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1eda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.257477:0:23435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1eda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.257484:0:23435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1eda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834180.257498:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834180.257526:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834180.257539:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63436d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787834180.257585:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406233856 00000100:00100000:0.0:1787834180.257589:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406233856 00000100:00100000:0.0:1787834180.257610:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787834180.257616:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+13:23435:x1874679406233856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834180.257623:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834180.257632:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504677200/0x996d2fb20dc1edab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1eda4 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.257645:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677200/0x996d2fb20dc1edab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1eda4 expref: 14 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.257654:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504677200/0x996d2fb20dc1edab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1eda4 expref: 14 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.257661:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677200, rc 0) 00000100:00100000:0.0:1787834180.257699:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+14:23435:x1874679406233856:12345-0@lo:101:mount.lustre.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834180.257977:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787834180.258049:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834180.258060:0:23435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1eda4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1edab expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.258068:0:23435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1eda4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1edab expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834180.258084:0:23435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787834180.258123:0:23435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1eda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1edab expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.258131:0:23435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4e200/0x996d2fb20dc1eda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1edab expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834180.258137:0:23435:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787834180.258148:0:23435:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787834180.258152:0:23435:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8df503c53800 10000000:01000000:2.0:1787834180.258155:0:23435:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787834180.258158:0:23435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787834180.258161:0:23435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787834180.258180:0:23435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e000/0x996d2fb20dc1edb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.258188:0:23435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4e000/0x996d2fb20dc1edb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.258195:0:23435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4e000/0x996d2fb20dc1edb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834180.258208:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834180.258309:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834180.258334:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63436d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787834180.258460:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406233984 00000100:00100000:0.0:1787834180.258465:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406233984 00000100:00100000:0.0:1787834180.258922:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787834180.258930:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+14:23435:x1874679406233984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834180.258941:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834180.258957:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504677600/0x996d2fb20dc1edb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1edb2 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.258987:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677600/0x996d2fb20dc1edb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1edb2 expref: 15 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.258995:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504677600/0x996d2fb20dc1edb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1edb2 expref: 15 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.259001:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677600, rc 0) 00000100:00100000:0.0:1787834180.259042:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406233984:12345-0@lo:101:mount.lustre.0 Request processed in 114us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834180.259048:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787834180.259254:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406233984:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834180.259269:0:23435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4e000/0x996d2fb20dc1edb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1edb9 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.259277:0:23435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4e000/0x996d2fb20dc1edb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1edb9 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787834180.261665:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1787834180.264445:0:23435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787834180.269222:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787834180.269295:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1787834180.269313:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1787834180.269328:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1787834180.269534:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1787834180.269556:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1787834180.269570:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1787834180.269584:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1787834180.269596:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1787834180.269610:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1787834180.269623:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1787834180.269634:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1787834180.269648:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1787834180.269681:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1787834180.269696:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1787834180.269708:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1787834180.269722:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1787834180.269734:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1787834180.269746:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1787834180.269877:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1787834180.269893:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1787834180.269908:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1787834180.269922:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1787834180.269937:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1787834180.269952:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1787834180.269963:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1787834180.269975:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1787834180.269987:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1787834180.269999:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1787834180.270010:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1787834180.270022:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1787834180.270035:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1787834180.270047:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1787834180.270061:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1787834180.270073:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1787834180.270085:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1787834180.270098:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1787834180.270111:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1787834180.270124:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1787834180.270136:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1787834180.270152:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1787834180.270166:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1787834180.270180:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1787834180.270192:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1787834180.270218:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1787834180.270224:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1787834180.270368:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1230c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406234112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834180.270448:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834180.270494:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834180.270510:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406234112 00000100:00100000:2.0:1787834180.270518:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406234112 00000100:00100000:2.0:1787834180.270570:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787834180.270579:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406234112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834180.270740:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406234112:12345-0@lo:501:mount.lustre.0 Request processed in 161us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834180.270775:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787834180.270822:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1230c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406234112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834180.270853:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1230c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406234240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834180.270898:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834180.270967:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834180.271062:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406234240 00000100:00100000:2.0:1787834180.271067:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406234240 00000100:00100000:2.0:1787834180.271135:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787834180.271143:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406234240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834180.275512:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406234240:12345-0@lo:503:mount.lustre.0 Request processed in 4360us (4609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.275527:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787834180.275561:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1230c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406234240:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787834180.276155:0:23435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787834180.276234:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406234368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834180.276503:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.276590:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834180.279864:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406234368 00000100:00100000:1.0:1787834180.279880:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406234368 00000100:00100000:1.0:1787834180.279956:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787834180.279968:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406234368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834180.281523:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406234368:12345-0@lo:502:mount.lustre.0 Request processed in 1550us (5014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834180.281535:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787834180.281693:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406234368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787834180.282154:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787834180.282180:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1787834180.282188:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1787834180.282195:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1787834180.282201:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1787834180.282208:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1787834180.282215:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1787834180.282221:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1787834180.282228:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1787834180.282239:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1787834180.282330:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1787834180.282482:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1787834180.282498:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1787834180.282512:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1787834180.282527:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1787834180.282539:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1787834180.282552:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1787834180.282566:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1787834180.282586:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1787834180.282599:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1787834180.282612:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1787834180.282625:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1787834180.282635:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1787834180.282648:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1787834180.282662:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1787834180.282674:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1787834180.282684:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1787834180.282694:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1787834180.284083:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1787834180.284119:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1787834180.284133:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1787834180.284147:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1787834180.284160:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1787834180.284175:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1787834180.284189:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1787834180.284203:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1787834180.284217:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1787834180.284231:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1787834180.284257:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1787834180.284274:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1787834180.284303:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1787834180.284320:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1787834180.284335:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1787834180.284369:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1787834180.285104:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406234496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834180.285191:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.286203:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.286672:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406234496 00000100:00100000:3.0:1787834180.286682:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406234496 00000100:00100000:3.0:1787834180.286778:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787834180.286790:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406234496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834180.287160:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406234496:12345-0@lo:502:mount.lustre.0 Request processed in 372us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.287169:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787834180.287200:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406234496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834180.287475:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1787834180.287490:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1787834180.290071:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834180.290085:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.290087:0:23439:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787834180.290094:0:23439:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787834180.290097:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787834180.290124:0:23439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8df5039b8000) 00000020:00000080:3.0:1787834180.290145:0:23439:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1787834180.290152:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787834180.290222:0:23439:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787834180.290246:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1edc7 00000020:00000080:3.0:1787834180.290487:0:23439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787834180.290507:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834180.290511:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.290512:0:23439:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787834180.290515:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834180.290518:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.290520:0:23439:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787834180.290523:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787834180.290531:0:23439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8df503f10000) 00000020:00000080:3.0:1787834180.290543:0:23439:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1787834180.290548:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787834180.290549:0:23439:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787834180.290552:0:23439:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787834180.290558:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787834180.290619:0:23439:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df503c53800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787834180.290632:0:23439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8df503f14ed8) 00000020:00000080:3.0:1787834180.290640:0:23439:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1787834180.290684:0:23439:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787834180.290691:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1eddc 00000020:00000080:3.0:1787834180.290805:0:23439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787834180.290812:0:23439:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787834180.290816:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x996d2fb20dc1ede3 00080000:01000000:3.0:1787834180.290821:0:23439:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787834180.290824:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1edea 00000100:00100000:0.0:1787834180.376457:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787834180.423060:0:23439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1787834180.423847:0:23439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1787834180.426315:0:23439:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787834180.429462:0:23439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787834180.429485:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834180.429492:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.429494:0:23439:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787834180.429501:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834180.429508:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.429510:0:23439:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787834180.429514:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787834180.429518:0:23439:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:00000080:1.0:1787834180.429555:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834180.429572:0:23439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8df634433490) 00000020:00000080:1.0:1787834180.429596:0:23439:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1787834180.429601:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787834180.429692:0:23439:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787834180.429698:0:23439:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787834180.429715:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1edf8 00010000:00080000:1.0:1787834180.429745:0:23439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df504748800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834180.431298:0:23439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787834180.449377:0:23439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787834180.449399:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787834180.449441:0:23439:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787834180.449463:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1edff 00000100:00080000:1.0:1787834180.449473:0:23439:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834180.449491:0:23439:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8df504748800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834180.449529:0:23439:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df636ad7c00 x1874679406234624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834180.449556:0:23439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787834180.449615:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834180.449619:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:2.0:1787834180.449620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000020:00000080:1.0:1787834180.449621:0:23439:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787834180.449627:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:2.0:1787834180.449629:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000020:01000000:1.0:1787834180.449632:0:23439:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000100:00080000:2.0:1787834180.449634:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df61e602800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:01000000:1.0:1787834180.449635:0:23439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834180.449638:0:23439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834180.449641:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00080000:2.0:1787834180.449643:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 652 00000020:00000080:1.0:1787834180.449645:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.449649:0:23439:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000100:00080000:2.0:1787834180.449650:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000020:01000000:1.0:1787834180.449652:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:2.0:1787834180.449658:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df61e602800 using connection 192.168.203.117@tcp/0@lo 00000020:00000080:1.0:1787834180.449659:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.449662:0:23439:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787834180.449668:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787834180.449681:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50568f840 x1874679406234752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787834180.449693:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834180.449696:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834180.449698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000004:01000000:1.0:1787834180.449710:0:23439:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00080000:2.0:1787834180.449712:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1787834180.449725:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834180.449731:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.449733:0:23439:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787834180.449736:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787834180.449738:0:23439:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1787834180.449739:0:23439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834180.449741:0:23439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787834180.449743:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:1.0:1787834180.449778:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787834180.449796:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406234880:0@lo:400:kworker.0 00000100:00100000:1.0:1787834180.449864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787834180.449910:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.449912:0:23439:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787834180.449922:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787834180.449925:0:23439:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787834180.449928:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.449930:0:23439:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787834180.449933:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787834180.449937:0:23439:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000100:00100000:2.0:1787834180.449955:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406234880 00000020:01000000:1.0:1787834180.449960:0:23439:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000100:00100000:2.0:1787834180.449963:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406234880 00000020:00000080:1.0:1787834180.449965:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787834180.449981:0:23439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8df60efcb490) 00000020:00000080:1.0:1787834180.449996:0:23439:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787834180.450002:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1787834180.450011:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787834180.450022:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406234880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834180.450087:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874679406234880:12345-0@lo:400:kworker.0 Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834180.450104:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787834180.450104:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df50568de00 x1874679406234880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834180.450119:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874679406234880:0@lo:400:kworker.0 00000004:00080000:1.0:1787834180.450140:0:23439:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787834180.450147:0:23439:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787834180.450153:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1ee0d 00010000:00080000:1.0:1787834180.450188:0:23439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df6359bb000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834180.450404:0:23439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1787834180.451404:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406234624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787834180.451474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.451550:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406234752:0@lo:38:kworker.0 00000100:00100000:0.0:1787834180.451572:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.453423:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406234624 00000100:00100000:1.0:1787834180.453436:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406234624 00000100:00100000:1.0:1787834180.453473:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406234752 00000100:00100000:1.0:1787834180.453476:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406234752 00000100:00100000:1.0:1787834180.453490:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787834180.453497:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406234624:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787834180.453525:0:22709:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:1.0:1787834180.453561:0:22709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1ee14 00000004:00100000:1.0:1787834180.453575:0:22709:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787834180.453581:0:22709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:0.0:1787834180.454487:0:23439:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787834180.455444:0:23439:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787834180.459513:0:23439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834180.459815:0:23439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1787834180.459960:0:23439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787834180.460657:0:23445:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787834180.460662:0:23445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787834180.461933:0:23439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787834180.461946:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787834180.461986:0:23439:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787834180.462009:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1ee1b 00000100:00080000:3.0:1787834180.462020:0:23439:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787834180.462026:0:23439:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df6359bb000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834180.462061:0:23439:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e120f00 x1874679406235008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834180.462087:0:23439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787834180.462135:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406235008:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1787834180.462154:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834180.462157:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.462158:0:23439:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787834180.462161:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787834180.462163:0:23439:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787834180.462165:0:23439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787834180.462166:0:23439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787834180.462168:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787834180.462169:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.462170:0:23439:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787834180.462173:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787834180.462176:0:23439:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787834180.462179:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.462180:0:23439:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787834180.462182:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787834180.462185:0:23439:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000400:00000100:0.0:1787834180.462187:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406235008 offset 0 length 520: 4 00000020:01000000:3.0:1787834180.462203:0:23439:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787834180.462331:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787834180.462344:0:23439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8df503f13490) 00000020:00000080:3.0:1787834180.462358:0:23439:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787834180.462364:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787834180.462433:0:23439:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787834180.462439:0:23439:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787834180.462447:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x996d2fb20dc1ee29 00010000:00080000:3.0:1787834180.462477:0:23439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df620707000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1787834180.462687:0:23439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787834180.462774:0:23439:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787834180.462791:0:23439:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1787834180.463120:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834180.463125:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834180.463128:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834180.463131:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834180.465105:0:22709:0:(import.c:65:import_set_state_nolock()) ffff8df502ccf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834180.465211:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874679406234624:12345-0@lo:38:llog_process_th.0 Request processed in 11711us (13735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834180.465228:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787834180.465256:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787834180.465263:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406234752:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787834180.465304:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406234752:12345-0@lo:38:kworker.0 Request processed in 41us (13731us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787834180.465309:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834180.465422:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787834180.465432:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787834180.465440:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787834180.465446:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787834180.465449:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df504748800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787834180.465467:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406234624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787834180.465492:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787834180.465496:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61e602800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787834180.465500:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787834180.465502:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406234752:0@lo:38:kworker.0 00000100:00100000:0.0:1787834180.466112:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787834180.466128:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406235136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834180.466171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834180.466249:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406235136 00000100:00100000:2.0:1787834180.466256:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406235136 00000100:00100000:2.0:1787834180.466300:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787834180.466307:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874679406235136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787834180.466343:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787834180.466445:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874679406235136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834180.466452:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787834180.466746:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406235136:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787834180.468325:0:23439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787834180.468656:0:23439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1787834180.468854:0:23439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1787834180.471945:0:23447:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787834180.471974:0:23447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787834180.473078:0:23439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787834180.473090:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787834180.473417:0:23439:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787834180.473442:0:23439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1ee30 00000100:00080000:1.0:1787834180.473452:0:23439:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834180.473457:0:23439:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df620707000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834180.473490:0:23439:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df636ad5e00 x1874679406235264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834180.473518:0:23439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787834180.473581:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834180.473585:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.473588:0:23439:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787834180.473591:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834180.473595:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.473597:0:23439:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000100:00080000:2.0:1787834180.473601:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1787834180.473602:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787834180.473606:0:23439:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00080000:2.0:1787834180.473608:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1787834180.473620:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:2.0:1787834180.473624:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1787834180.473625:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:2.0:1787834180.473628:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1787834180.473633:0:23439:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787834180.473638:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787834180.473641:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.473642:0:23439:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787834180.473646:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787834180.473876:0:23439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787834180.473895:0:23439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787834180.473897:0:23439:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787834180.473901:0:23439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:0.0:1787834180.473958:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406235264:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787834180.474018:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406235264 offset 0 length 520: 4 00000020:01000000:2.0:1787834180.474110:0:23435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787834180.474142:0:23435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787834180.474155:0:23435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e000/0x996d2fb20dc1edb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1edb9 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.474171:0:23435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4e000/0x996d2fb20dc1edb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1edb9 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834180.474180:0:23435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df503c53800 from 1 10000000:01000000:2.0:1787834180.474182:0:23435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787834180.474206:0:23435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.474214:0:23435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.474224:0:23435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834180.474239:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834180.474277:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834180.474300:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834180.474362:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406235392 00000100:00100000:1.0:1787834180.474369:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406235392 00000100:00100000:1.0:1787834180.474478:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787834180.474489:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+15:23435:x1874679406235392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834180.474502:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834180.474515:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ee37 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.474538:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee37 expref: 16 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.474549:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee37 expref: 16 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.474556:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b800, rc 0) 00000100:00100000:1.0:1787834180.474613:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+16:23435:x1874679406235392:12345-0@lo:101:mount.lustre.0 Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834180.474620:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787834180.474695:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834180.474710:0:23435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.474718:0:23435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834180.475328:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235520:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787834180.475372:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834180.476134:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.480195:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406235520 00000100:00100000:3.0:1787834180.480211:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406235520 00000100:00100000:2.0:1787834180.480471:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787834180.480481:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+16:23435:x1874679406235520:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787834180.480506:0:22700:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787834180.480530:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787834180.480533:0:22700:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787834180.480744:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+16:23435:x1874679406235520:12345-0@lo:256:mount.lustre.0 Request processed in 264us (5369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834180.483307:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235520:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787834180.483593:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 10000000:01000000:1.0:1787834180.484563:0:23435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787834180.484601:0:23435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.484624:0:23435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834180.484633:0:23435:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df503c53800 from 1 10000000:01000000:1.0:1787834180.484635:0:23435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787834180.484672:0:23435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.484680:0:23435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.484690:0:23435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834180.484711:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834180.484812:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.484841:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.484962:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406235648 00000100:00100000:3.0:1787834180.484971:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406235648 00000100:00100000:3.0:1787834180.485019:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787834180.485028:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+16:23435:x1874679406235648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834180.485041:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834180.485053:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ee45 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.485076:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee45 expref: 17 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.485085:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee45 expref: 17 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.485092:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6c00, rc 0) 00000100:00100000:3.0:1787834180.485130:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406235648:12345-0@lo:101:mount.lustre.0 Request processed in 104us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.485137:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787834180.485485:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834180.485496:0:23435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.485502:0:23435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787834180.486580:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1787834180.487142:0:23435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834180.487691:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787834180.487719:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1787834180.487744:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1787834180.488083:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1787834180.488103:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1787834180.488119:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1787834180.488133:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1787834180.488218:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1787834180.488301:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787834180.488334:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1787834180.488352:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1787834180.488371:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1787834180.488377:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1787834180.488475:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834180.488539:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834180.488696:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406235776 00000100:00100000:2.0:1787834180.488702:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406235776 00000100:00100000:2.0:1787834180.488875:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787834180.488885:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406235776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834180.488997:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406235776:12345-0@lo:501:mount.lustre.0 Request processed in 113us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834180.489005:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787834180.489055:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adb240 going to sleep for 11 seconds 00000100:00100000:1.0:1787834180.489077:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834180.489108:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834180.489158:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.489411:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.489487:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406235904 00000100:00100000:3.0:1787834180.489492:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406235904 00000100:00100000:3.0:1787834180.489516:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787834180.489522:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406235904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834180.489619:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406235904:12345-0@lo:503:mount.lustre.0 Request processed in 96us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.489626:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787834180.489711:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406235904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787834180.490089:0:23435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787834180.490157:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834180.490195:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.490215:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.490474:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406236032 00000100:00100000:3.0:1787834180.490485:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406236032 00000100:00100000:3.0:1787834180.490511:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787834180.490518:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406236032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834180.490608:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406236032:12345-0@lo:502:mount.lustre.0 Request processed in 90us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.490615:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787834180.490739:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834180.490930:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787834180.490955:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1787834180.490968:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1787834180.490990:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1787834180.491004:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1787834180.491018:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1787834180.491031:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1787834180.491042:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1787834180.491053:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787834180.491064:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1787834180.491077:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1787834180.491114:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834180.491429:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.491465:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.491564:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406236160 00000100:00100000:3.0:1787834180.491569:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406236160 00000100:00100000:3.0:1787834180.491607:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787834180.491614:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406236160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834180.491702:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406236160:12345-0@lo:502:mount.lustre.0 Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.491709:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787834180.494449:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834180.494549:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1787834180.494564:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787834180.495666:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834180.495677:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.495679:0:23449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787834180.495686:0:23449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df503c53800 00000020:00000080:3.0:1787834180.495688:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834180.495695:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834180.495698:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.495699:0:23449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787834180.495701:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834180.495703:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.495705:0:23449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787834180.495708:0:23449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df503c53800 00000020:00000080:3.0:1787834180.495710:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834180.495809:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834180.495814:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.495815:0:23449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787834180.495818:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834180.495828:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.495829:0:23449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834180.495833:0:23449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df503c53800 00000020:00000080:3.0:1787834180.495835:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834180.495853:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834180.495855:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.495856:0:23449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834180.495859:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834180.495861:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.495862:0:23449:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787834180.495865:0:23449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df503c53800 00000020:00000080:3.0:1787834180.495867:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834180.495886:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834180.495889:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834180.495890:0:23449:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787834180.495893:0:23449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1787834180.497041:0:23435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787834180.497076:0:23435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787834180.497366:0:23435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.497389:0:23435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834180.497445:0:23435:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787834180.497448:0:23435:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df503c53800 10000000:01000000:2.0:1787834180.497451:0:23435:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df503c53800 10000000:01000000:2.0:1787834180.497454:0:23435:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787834180.497459:0:23435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df503c53800 from 1 10000000:01000000:2.0:1787834180.497466:0:23435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787834180.497501:0:23435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4ec00/0x996d2fb20dc1ee53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.497510:0:23435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4ec00/0x996d2fb20dc1ee53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.497520:0:23435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4ec00/0x996d2fb20dc1ee53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834180.497541:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787834180.497607:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834180.497641:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.498069:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406236288 00000100:00100000:3.0:1787834180.498076:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406236288 00000100:00100000:3.0:1787834180.498119:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787834180.498128:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:23435:x1874679406236288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834180.498141:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834180.498154:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1ee5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ee53 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.498178:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1ee5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee53 expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.498189:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6200/0x996d2fb20dc1ee5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee53 expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.498197:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6200, rc 0) 00000100:00100000:3.0:1787834180.498571:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236288:12345-0@lo:101:mount.lustre.0 Request processed in 444us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.498578:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787834180.502364:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834180.502403:0:23435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4ec00/0x996d2fb20dc1ee53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee5a expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834180.502416:0:23435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4ec00/0x996d2fb20dc1ee53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ee5a expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787834180.516104:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1787834180.516482:0:23435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834180.516693:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1787834180.516719:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1787834180.516739:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1787834180.516776:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1787834180.516792:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1787834180.516803:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1787834180.516815:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1787834180.516825:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1787834180.516835:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1787834180.516844:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1787834180.516854:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1787834180.516865:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1787834180.516876:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1787834180.516894:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1787834180.516905:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1787834180.516956:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1787834180.516971:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1787834180.516985:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1787834180.516999:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1787834180.517013:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1787834180.517038:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1787834180.517051:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1787834180.517062:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1787834180.517074:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1787834180.517085:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1787834180.517097:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1787834180.517108:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1787834180.519565:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1787834180.519627:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1787834180.519643:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1787834180.519655:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1787834180.519669:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1787834180.519697:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1787834180.519711:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1787834180.519726:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1787834180.519738:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1787834180.519784:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1787834180.519801:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1787834180.519814:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1787834180.519825:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1787834180.519837:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1787834180.519848:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1787834180.519860:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1787834180.519872:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1787834180.519883:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1787834180.519895:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1787834180.519906:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1787834180.519918:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1787834180.520073:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1787834180.520105:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1787834180.520474:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1787834180.520485:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1787834180.520591:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834180.520658:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.521014:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834180.521289:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406236416 00000100:00100000:0.0:1787834180.521297:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406236416 00000100:00100000:0.0:1787834180.521343:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787834180.521352:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834180.521491:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236416:12345-0@lo:501:mount.lustre.0 Request processed in 140us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834180.521498:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787834180.521815:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834180.521855:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834180.521901:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.521929:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602adb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834180.521944:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406236544 00000100:00100000:1.0:1787834180.521947:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406236544 00000100:00100000:1.0:1787834180.522262:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787834180.522271:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834180.522359:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236544:12345-0@lo:503:mount.lustre.0 Request processed in 89us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834180.522365:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787834180.522423:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236544:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787834180.525147:0:23435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787834180.525246:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834180.525317:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.525362:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.525481:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406236672 00000100:00100000:3.0:1787834180.525489:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406236672 00000100:00100000:3.0:1787834180.525535:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787834180.525542:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834180.525654:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236672:12345-0@lo:502:mount.lustre.0 Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.525661:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787834180.526108:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834180.526306:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1787834180.526341:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1787834180.526356:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1787834180.526368:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1787834180.526390:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1787834180.526406:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1787834180.526419:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1787834180.526433:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1787834180.526444:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1787834180.526456:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1787834180.526468:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1787834180.526480:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1787834180.526493:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1787834180.526506:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1787834180.526534:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1787834180.526549:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1787834180.526562:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1787834180.526573:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1787834180.526584:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1787834180.526597:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1787834180.526609:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1787834180.526621:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1787834180.526634:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1787834180.526645:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1787834180.526658:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1787834180.526670:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1787834180.526683:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1787834180.526712:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1787834180.526726:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1787834180.526739:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1787834180.526792:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1787834180.526809:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1787834180.526821:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1787834180.526833:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1787834180.526855:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1787834180.526868:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1787834180.526881:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1787834180.526897:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1787834180.526911:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1787834180.526927:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1787834180.526945:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1787834180.526963:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1787834180.526979:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1787834180.526995:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1787834180.527013:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1787834180.527031:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1787834180.527060:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1787834180.527080:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1787834180.527129:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834180.527190:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.527230:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.527377:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406236800 00000100:00100000:3.0:1787834180.527392:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406236800 00000100:00100000:3.0:1787834180.527436:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787834180.527445:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834180.527562:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236800:12345-0@lo:502:mount.lustre.0 Request processed in 117us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.527570:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787834180.529361:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834180.529584:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1787834180.529615:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1787834180.529874:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834180.529940:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.529978:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406236928 00000100:00100000:1.0:1787834180.529983:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406236928 00000100:00100000:1.0:1787834180.530023:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787834180.530030:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834180.530134:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406236928:12345-0@lo:502:mount.lustre.0 Request processed in 104us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834180.530142:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787834180.530188:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6106c0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834180.530201:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406236928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834180.530238:0:23435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1787834180.530247:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787834180.531145:0:23454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787834180.531158:0:23454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8df62ea94ed8) 00000020:00000080:2.0:1787834180.531174:0:23454:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787834180.531470:0:23454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df503c53800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787834180.531475:0:23454:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df503c53800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787834180.531478:0:23454:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df503c53800 3 00010000:00080000:2.0:1787834180.531507:0:23454:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df503bc0800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1787834180.535903:0:23454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787834180.536112:0:23454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787834180.536158:0:23454:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787834180.536170:0:23454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x996d2fb20dc1ee68 00000100:00080000:3.0:1787834180.536180:0:23454:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787834180.536187:0:23454:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8df503bc0800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834180.536221:0:23454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e1221c0 x1874679406237056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834180.536259:0:23454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787834180.536776:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406237056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787834180.536849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834180.536989:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406237056 00000100:00100000:3.0:1787834180.537007:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406237056 00000100:00100000:3.0:1787834180.537446:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787834180.537454:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406237056:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787834180.537479:0:22706:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:3.0:1787834180.537515:0:22706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x996d2fb20dc1ee6f 00000004:00100000:3.0:1787834180.537529:0:22706:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787834180.537558:0:22706:0:(import.c:65:import_set_state_nolock()) ffff8df502ccf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834180.537616:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874679406237056:12345-0@lo:38:llog_process_th.0 Request processed in 162us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.537624:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787834180.537693:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834180.537699:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834180.537709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834180.537712:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1787834180.537853:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df60e1221c0 x1874679406237056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834180.537863:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787834180.537870:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787834180.537877:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787834180.537882:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787834180.537884:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df503bc0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787834180.537889:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874679406237056:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787834180.538015:0:23454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1787834180.538905:0:23435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787834180.539035:0:23435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787834180.539053:0:23435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4ec00/0x996d2fb20dc1ee53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee5a expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.539064:0:23435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4ec00/0x996d2fb20dc1ee53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee5a expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787834180.539124:0:23435:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787834180.539126:0:23435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787834180.539127:0:23435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834180.539128:0:23435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834180.539129:0:23435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834180.539131:0:23435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834180.539132:0:23435:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787834180.539134:0:23435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834180.539135:0:23435:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787834180.539138:0:23435:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787834180.539140:0:23435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787834180.539141:0:23435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787834180.539142:0:23435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834180.539143:0:23435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834180.539144:0:23435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834180.539145:0:23435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834180.539146:0:23435:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787834180.539147:0:23435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834180.539147:0:23435:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787834180.539168:0:23435:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787834180.539183:0:23435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406237184:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787834180.539560:0:23435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.539635:0:23435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63436dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834180.539673:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406237184 00000100:00100000:3.0:1787834180.539680:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406237184 00000100:00100000:3.0:1787834180.539785:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787834180.539794:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406237184:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787834180.540079:0:22700:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787834180.540092:0:22700:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787834180.550252:0:22685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787834180.550341:0:22700:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787834180.550359:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787834180.550408:0:22720:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787834180.550414:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787834180.550502:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.550534:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed73 expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.550541:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee37 expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.550547:0:22720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.550583:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ee37 expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.550595:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee37 expref: 18 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834180.550610:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359db0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406237312:0@lo:104: 00000100:00100000:0.0:1787834180.550677:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.550703:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:23435:x1874679406237184:12345-0@lo:253:mount.lustre.0 Request processed in 10907us (11140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834180.550716:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1787834180.550729:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ed73 expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834180.550739:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed73 expref: 17 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834180.550744:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406237312 00000100:00100000:0.0:1787834180.550785:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406237440:0@lo:104: 00000100:00100000:0.0:1787834180.550809:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.550838:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63436d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787834180.550855:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406237440 00000100:00100000:1.0:1787834180.550862:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406237440 00000100:00100000:1.0:1787834180.550897:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787834180.550906:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406237440:12345-0@lo:104: 00010000:00010000:1.0:1787834180.550918:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834180.550992:0:23435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:23435:1874679406237184:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1787834180.551003:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:2.0:1787834180.551005:0:23435:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787834180.551010:0:23435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000100:00100000:1.0:1787834180.551011:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406237440:12345-0@lo:104: Request processed in 106us (201us total) trans 0 rc 0/0 00000020:01000004:2.0:1787834180.551013:0:23435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787834180.551017:0:23435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834180.551020:0:23435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834180.551021:0:23435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1787834180.551022:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:2.0:1787834180.551135:0:23435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834180.551136:0:23435:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787834180.551138:0:23435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834180.551140:0:23435:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787834180.551155:0:23435:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787834180.551223:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406237312 00000100:00100000:3.0:1787834180.551257:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787834180.551264:0:22689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406237312:12345-0@lo:104: 00010000:00010000:3.0:1787834180.551272:0:22689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.551308:0:22689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787834180.551313:0:22689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406237312:12345-0@lo:104: Request processed in 51us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.551319:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787834180.551329:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787834180.551335:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.551343:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677000 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787834180.551347:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.551355:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787834180.551368:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834180.551374:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787834180.551416:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.551424:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787834180.551448:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.551456:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504677000/0x996d2fb20dc1ed73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ed7a expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.551467:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787834180.551468:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406237568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834180.551470:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.551475:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787834180.551478:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.551484:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787834180.551490:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834180.551495:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787834180.551496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834180.551519:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.551525:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787834180.551525:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834180.551527:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406237568 00000100:00100000:3.0:1787834180.551532:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406237568 00010000:00010000:1.0:1787834180.551538:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834180.551542:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9903e54-1448-45ce-bd63-f50f2c84e331:3639:1874679406237696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834180.551547:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4e600/0x996d2fb20dc1ee37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee3e expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.551549:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed73 expref: 18 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.551561:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834180.551564:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834180.551565:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834180.551571:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834180.551578:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e122d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:3638:x1874679406237568:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834180.551590:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834180.551636:0:22692:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787834180.551641:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359db0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406237312:0@lo:104: 00000100:00100000:1.0:1787834180.551646:0:22692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787834180.551654:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406237440:0@lo:104: 00010000:00010000:0.0:1787834180.551670:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552020:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834180.552027:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed73 expref: 18 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552037:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed73 expref: 18 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552050:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b7200/0x996d2fb20dc1ed7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ed73 expref: 18 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552062:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834180.552099:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e122d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:3638:x1874679406237568:12345-0@lo:103:ldlm_bl.0 Request processed in 522us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.552106:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787834180.552118:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406237696 00000100:00100000:3.0:1787834180.552122:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406237696 00010000:00010000:3.0:1787834180.552135:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee37 expref: 17 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834180.552158:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787834180.552165:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:3639:x1874679406237696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834180.552178:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834180.552183:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee37 expref: 17 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552192:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee37 expref: 17 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552202:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1ee3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ee37 expref: 17 pid: 22699 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552212:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552219:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834180.552224:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406237568:0@lo:103:ldlm_bl.0 20000000:01000000:3.0:1787834180.552230:0:22690:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001817457s 00010000:00010000:3.0:1787834180.552234:0:22690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552241:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552247:0:22690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552254:0:22690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552260:0:22690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834180.552263:0:22690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552277:0:22690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552301:0:22690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834180.552311:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834180.552340:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+16:3639:x1874679406237696:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834180.552347:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787834180.552473:0:22720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.552482:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834180.552488:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676600/0x996d2fb20dc1ee76 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834180.553862:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9903e54-1448-45ce-bd63-f50f2c84e331:3639:1874679406237696:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1787834180.558348:0:23435:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787834180.558698:0:23461:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787834180.558703:0:23461:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787834180.567683:0:23462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1787834180.568273:0:23462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787834180.570808:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787834180.570909:0:23462:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1787834180.573463:0:23435:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1787834180.575617:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23463:1874679406237824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787834180.575694:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.575731:0:23463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e138600 going to sleep for 11 seconds 00000100:00100000:0.0:1787834180.575790:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406237824 00000100:00100000:0.0:1787834180.575796:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406237824 00000100:00100000:0.0:1787834180.575851:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787834180.575860:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23463:x1874679406237824:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787834180.575903:0:23435:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1787834180.575938:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23463:x1874679406237824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000040:00080000:3.0:1787834180.575945:0:23435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787834180.575945:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787834180.575983:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23463:1874679406237824:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787834180.576009:0:23463:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787834180.576033:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23463:1874679406237952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787834180.576060:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.576078:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406237952 00000100:00100000:0.0:1787834180.576082:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406237952 00000100:00100000:0.0:1787834180.576098:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787834180.576104:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23463:x1874679406237952:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787834180.576211:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23463:x1874679406237952:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 107us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834180.576217:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787834180.576246:0:23463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e138600 going to sleep for 11 seconds 00000100:00100000:0.0:1787834180.576259:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23463:1874679406237952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787834180.576301:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23463:1874679406238080:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787834180.576325:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.576369:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406238080 00000100:00100000:0.0:1787834180.576373:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406238080 00000100:00100000:0.0:1787834180.576405:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787834180.576410:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23463:x1874679406238080:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787834180.577191:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23463:x1874679406238080:12345-0@lo:900:lod0001_rec0000.0 Request processed in 779us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834180.577199:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787834180.577222:0:23463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e138900 going to sleep for 11 seconds 00010000:00080000:0.0:1787834180.577255:0:23463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8df6359db480 x1874679406238080/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787834196 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834180.577268:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23463:1874679406238080:0@lo:900:lod0001_rec0000.0 00000004:00000080:3.0:1787834180.577313:0:23435:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:0.0:1787834180.577315:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23463:1874679406238208:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787834180.577324:0:23435:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1787834180.577352:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834180.577387:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406238208 00000100:00100000:0.0:1787834180.577391:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406238208 00000040:00080000:3.0:1787834180.577395:0:23435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787834180.577414:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787834180.577421:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23463:x1874679406238208:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787834180.577597:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23463:x1874679406238208:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 175us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834180.577603:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787834180.577617:0:23463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e138600 going to sleep for 11 seconds 00000100:00100000:0.0:1787834180.577628:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23463:1874679406238208:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787834180.577687:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787834180.580589:0:23435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787834180.582350:0:23435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787834180.582423:0:23435:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787834180.582604:0:23435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787834180.583459:0:23435:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1787834180.585513:0:23435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:0.0:1787834180.587145:0:23463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787834180.587223:0:23463:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787834180.587228:0:23463:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1787834180.605691:0:23435:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787834180.605741:0:23435:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9fc9c17ab988 00100000:10000000:2.0:1787834180.605865:0:23435:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787834180.607185:0:23435:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787834180.607216:0:23435:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787834180.607345:0:23435:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787834180.607362:0:23435:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787834180.611736:0:23435:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834180.613629:0:23435:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787834180.760861:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834181.397845:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00000040:00080000:3.0:1787834181.591118:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787834181.787817:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834182.421838:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 10000000:01000000:1.0:1787834182.549834:0:22703:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787834182.549841:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df503c53800 from 12 10000000:01000000:1.0:1787834182.549847:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787834182.549895:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834182.549926:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834182.549936:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834182.549960:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406238336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787834182.550039:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834182.550083:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787834182.550214:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406238336 00000100:00100000:0.0:1787834182.550222:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406238336 00000100:00100000:0.0:1787834182.550276:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787834182.550286:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+16:22703:x1874679406238336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834182.550299:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834182.550311:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ee7d expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834182.550333:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee7d expref: 17 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834182.550343:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee7d expref: 17 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834182.550351:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676200, rc 0) 00000100:00100000:0.0:1787834182.550408:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406238336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834182.550424:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787834182.550796:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406238336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834182.550812:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834182.550822:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834182.550875:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406238464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787834182.550919:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834182.550946:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503847d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787834182.551001:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406238464 00000100:00100000:1.0:1787834182.551005:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406238464 00000100:00100000:1.0:1787834182.551041:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787834182.551048:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406238464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787834182.551063:0:22700:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787834182.551078:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787834182.551081:0:22700:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787834182.551163:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406238464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834182.551170:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787834182.551240:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406238464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787834182.551281:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787834182.551288:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834182.551297:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834182.551305:0:22703:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787834182.551307:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60ed4e000 from 12 10000000:01000000:2.0:1787834182.551310:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787834182.551327:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834182.551334:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834182.551341:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834182.551354:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406238592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787834182.551394:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834182.551423:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503847d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787834182.551525:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406238592 00000100:00100000:1.0:1787834182.551530:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406238592 00000100:00100000:1.0:1787834182.551559:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787834182.551566:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406238592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834182.551574:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834182.551585:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ee8b expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834182.551611:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee8b expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834182.551619:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee8b expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834182.551627:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3b000, rc 0) 00000100:00100000:1.0:1787834182.551653:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:22703:x1874679406238592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834182.551659:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787834182.552074:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406238592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834182.552087:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834182.552095:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834182.552138:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406238720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787834182.552167:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834182.552233:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503847d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787834182.552272:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406238720 00000100:00100000:1.0:1787834182.552276:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406238720 00000100:00100000:1.0:1787834182.552336:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787834182.552343:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:22703:x1874679406238720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787834182.552356:0:22698:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787834182.552381:0:22698:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787834182.552384:0:22698:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787834182.552447:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:22703:x1874679406238720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834182.552454:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787834182.552575:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406238720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787834182.552608:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787834182.552615:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834182.552623:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787834182.619622:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787834182.809376:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834183.449180:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787834183.829895:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834184.469956:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00000001:02000400:3.0:1787834184.569320:0:23705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787834184.854873:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787834185.481149:0:23757:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787834185.481398:0:23757:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787834185.515015:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 0 seconds 00000100:00100000:2.0:1787834185.563015:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406238848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834185.563398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787834185.563520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787834185.563524:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787834185.563528:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df61e602800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787834185.563537:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8df61e602800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834185.563556:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df63fcb2940 x1874679406239104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787834185.563572:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834185.563576:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834185.563579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834185.563581:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834185.563599:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834185.563602:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834185.563605:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834185.563608:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787834185.563643:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406239104:0@lo:38:kworker.0 00000100:00100000:0.0:1787834185.563674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834185.563702:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406239232:0@lo:400:kworker.0 00000100:00100000:0.0:1787834185.563727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834185.563745:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787834185.564176:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406238848 00000100:00100000:3.0:1787834185.564185:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406238848 00000100:00100000:3.0:1787834185.564291:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406239104 00000100:00100000:3.0:1787834185.564296:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406239104 00000100:00100000:3.0:1787834185.564309:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834185.564317:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406238848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787834185.564386:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787834185.564437:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406238848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834185.564444:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834185.564463:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787834185.564467:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874679406239104:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787834185.564488:0:22709:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:3.0:1787834185.564516:0:22709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1ee99 00000004:00100000:3.0:1787834185.564529:0:22709:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787834185.564534:0:22709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1787834185.564671:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406238976:0@lo:400:kworker.0 00000100:00100000:2.0:1787834185.564705:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834185.564849:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406238848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834185.564879:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406238976 00000100:00100000:2.0:1787834185.564882:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406238976 00000100:00100000:2.0:1787834185.564910:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787834185.564916:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:3641:x1874679406238976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834185.564950:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:3641:x1874679406238976:12345-0@lo:400:kworker.0 Request processed in 34us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834185.564956:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787834185.564996:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406238976:0@lo:400:kworker.0 00000100:00100000:0.0:1787834185.565126:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406239360:0@lo:400:kworker.0 00000100:00100000:0.0:1787834185.565154:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834185.565949:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406239360 00000100:00100000:2.0:1787834185.565956:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406239360 00000100:00100000:2.0:1787834185.565996:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787834185.566003:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406239360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834185.566181:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406239232 00000100:00100000:0.0:1787834185.566186:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406239232 00000100:00100000:0.0:1787834185.566285:0:22705:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787834185.566293:0:22705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787834185.566399:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787834185.566406:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406239232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834185.566443:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406239232:12345-0@lo:400:kworker.0 Request processed in 37us (2715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834185.566449:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787834185.566677:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406239360:12345-0@lo:400:kworker.0 Request processed in 56us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834185.566685:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787834185.566730:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df63fcb1680 x1874679406239360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834185.566743:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406239360:0@lo:400:kworker.0 00010000:00080000:2.0:1787834185.566908:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df63fcb0f00 x1874679406239232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834185.566918:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406239232:0@lo:400:kworker.0 00000100:00080000:3.0:1787834185.575035:0:22709:0:(import.c:65:import_set_state_nolock()) ffff8df6071ed000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834185.575297:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874679406239104:12345-0@lo:38:kworker.0 Request processed in 10826us (11620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834185.575322:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787834185.584142:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787834185.584157:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787834185.584163:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787834185.584167:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61e602800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787834185.584191:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000071811fd2): req@ffff8df636ad4780 x1874679406232064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834185.588860:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406239488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787834185.588935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834185.588993:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406239488 00000100:00100000:1.0:1787834185.589000:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406239488 00000100:00100000:1.0:1787834185.589043:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787834185.589051:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406239488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787834185.589305:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787834185.589368:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406239488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 317us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834185.589375:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787834185.589423:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406239488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834185.589718:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406239104:0@lo:38:kworker.0 00000100:00100000:2.0:1787834185.593140:0:22746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834185.593511:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787834185.593574:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406232064 00000100:00100000:3.0:1787834185.593582:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406232064 00000100:00100000:3.0:1787834185.593668:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787834185.593678:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1874679406232064:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787834185.593813:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1874679406232064:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 138us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834185.593822:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787834185.594175:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22746:1874679406232064:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1787834185.594281:0:22746:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787834185.594324:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568e580 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22746:1874679406239616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787834185.594368:0:22746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834185.594423:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ffd23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834185.594457:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406239616 00000100:00100000:3.0:1787834185.594462:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406239616 00000100:00100000:3.0:1787834185.594483:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787834185.594489:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1874679406239616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787834185.594608:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1874679406239616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 118us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834185.594614:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787834185.595037:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568e580 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22746:1874679406239616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787834185.595109:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568e580 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22746:1874679406239744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787834185.595135:0:22746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834185.595165:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406239744 00000100:00100000:2.0:1787834185.595169:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406239744 00000100:00100000:2.0:1787834185.595190:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787834185.595322:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1874679406239744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787834185.595381:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1874679406239744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834185.595387:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787834185.595405:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ffd23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834185.595417:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568e580 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22746:1874679406239744:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787834185.595451:0:22746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834185.601569:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787834185.601646:0:22746:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1787834185.601651:0:22746:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787834185.878377:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787834186.368717:0:23808:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834186.369038:0:23808:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787834186.901870:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787834187.411151:0:23856:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfdedb2c0 20000000:00000080:1.0:1787834187.411170:0:23856:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df60703dc00 uarg=0000000000000000 20000000:01000000:1.0:1787834187.411208:0:23856:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787834187.411215:0:23856:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787834187.411219:0:23856:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787834187.411606:0:23857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787834187.412106:0:23856:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787834187.419596:0:23856:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787834187.419625:0:23856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834187.419998:0:23856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ed42 expref: 17 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834187.420009:0:23856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee45 expref: 17 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834187.420016:0:23856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834187.420059:0:23856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ee45 expref: 17 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834187.420074:0:23856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee45 expref: 17 pid: 22698 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834187.420104:0:23856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23856:1874679406239872:0@lo:104: 00000100:00100000:1.0:1787834187.420169:0:23856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834187.420236:0:23856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ed42 expref: 17 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834187.420244:0:23856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed42 expref: 17 pid: 22699 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834187.420252:0:23856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23856:1874679406240000:0@lo:104: 00000100:00100000:1.0:1787834187.420273:0:23856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834187.420288:0:23856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63c3e79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834187.420411:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406239872 00000100:00100000:0.0:1787834187.420419:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406239872 00000100:00100000:0.0:1787834187.420503:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406240000 00000100:00100000:0.0:1787834187.420507:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406240000 00000100:00100000:0.0:1787834187.420524:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787834187.420531:0:22689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+4:23856:x1874679406239872:12345-0@lo:104: 00010000:00010000:0.0:1787834187.420542:0:22689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420600:0:22689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787834187.420612:0:22689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+4:23856:x1874679406239872:12345-0@lo:104: Request processed in 81us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834187.420624:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787834187.420657:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834187.420665:0:22689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+3:23856:x1874679406240000:12345-0@lo:104: 00010000:00010000:0.0:1787834187.420673:0:22689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420711:0:22689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787834187.420716:0:22689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+3:23856:x1874679406240000:12345-0@lo:104: Request processed in 53us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834187.420722:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787834187.420737:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787834187.420743:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420772:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a800 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834187.420776:0:22694:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420785:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834187.420792:0:22694:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834187.420798:0:22694:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787834187.420822:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420839:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787834187.420872:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420880:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1ee45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee4c expref: -99 pid: 23435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420893:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834187.420896:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420901:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7e00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834187.420904:0:22694:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420909:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834187.420915:0:22694:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834187.420919:0:22694:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787834187.420933:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420939:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787834187.420953:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420958:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b7e00/0x996d2fb20dc1ed42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ed49 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.420976:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834187.420978:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834187.420980:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834187.420992:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406240128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834187.421022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834187.421052:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406240256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834187.421073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834187.421103:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406240128 00000100:00100000:0.0:1787834187.421107:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406240128 00010000:00010000:0.0:1787834187.421127:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee45 expref: 18 pid: 22698 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834187.421144:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406240256 00000100:00100000:0.0:1787834187.421147:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406240256 00010000:00010000:0.0:1787834187.421158:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed42 expref: 19 pid: 22699 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834187.421172:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787834187.421177:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9903e54-1448-45ce-bd63-f50f2c84e331+19:3641:x1874679406240128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834187.421198:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834187.421203:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee45 expref: 19 pid: 22698 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421212:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee45 expref: 19 pid: 22698 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421227:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834187.421257:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9903e54-1448-45ce-bd63-f50f2c84e331+19:3641:x1874679406240128:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834187.421269:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787834187.421282:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834187.421287:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:3638:x1874679406240256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834187.421295:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834187.421300:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed42 expref: 18 pid: 22699 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421308:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ed42 expref: 18 pid: 22699 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421319:0:22692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421326:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421349:0:22692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421355:0:22692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421362:0:22692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421368:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421373:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834187.421376:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421389:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421398:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.421407:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834187.421434:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:3638:x1874679406240256:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834187.421440:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834187.421472:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406240256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834187.421495:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406240128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834187.421774:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834187.421901:0:23856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ee4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ee45 expref: 17 pid: 22698 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834187.421911:0:23856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23856:1874679406239872:0@lo:104: 00010000:00010000:1.0:1787834187.421919:0:23856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b400/0x996d2fb20dc1ed49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ed42 expref: 16 pid: 22699 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834187.421926:0:23856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23856:1874679406240000:0@lo:104: 00010000:00010000:1.0:1787834187.421942:0:23856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834187.421950:0:23856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834187.421956:0:23856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834187.421972:0:23856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b800/0x996d2fb20dc1eea0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834187.930001:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787834188.566769:0:22703:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787834188.566776:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df503c53800 from 13 10000000:01000000:3.0:1787834188.566782:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787834188.566832:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834188.566843:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834188.566854:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834188.566883:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787834188.566946:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834188.567121:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834188.570624:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406240384 00000100:00100000:1.0:1787834188.570637:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406240384 00000100:00100000:1.0:1787834188.570686:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787834188.570695:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+16:22703:x1874679406240384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834188.570848:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834188.571260:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1eea7 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834188.571289:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1eea7 expref: 17 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834188.571300:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1eea7 expref: 17 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834188.571310:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ae00, rc 0) 00000100:00100000:1.0:1787834188.571386:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406240384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 693us (4441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834188.571393:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787834188.571986:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834188.572008:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834188.572019:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834188.572092:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834188.572129:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834188.572172:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834188.572375:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406240512 00000100:00100000:1.0:1787834188.572380:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406240512 00000100:00100000:1.0:1787834188.572422:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787834188.572430:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406240512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787834188.572543:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406240512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834188.572561:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787834188.572678:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834188.572709:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787834188.572781:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834188.572799:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834188.572862:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406240640 00000100:00100000:0.0:1787834188.572866:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406240640 00000100:00100000:0.0:1787834188.572900:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787834188.572908:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406240640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787834188.573007:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406240640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834188.573014:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787834188.573183:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787834188.574338:0:23914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787834188.574501:0:22703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787834188.574531:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787834188.574541:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834188.574551:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834188.574571:0:22703:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787834188.574573:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df60ed4e000 from 13 10000000:01000000:3.0:1787834188.574576:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787834188.574607:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834188.574614:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834188.574624:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834188.574643:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787834188.574694:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834188.574733:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834188.574952:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406240768 00000100:00100000:1.0:1787834188.574959:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406240768 00000100:00100000:1.0:1787834188.575946:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787834188.575957:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+17:22703:x1874679406240768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834188.576902:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834188.576923:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1eeb5 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834188.576951:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1eeb5 expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834188.576962:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1eeb5 expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834188.577100:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3ba00, rc 0) 00000100:00100000:1.0:1787834188.577173:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:22703:x1874679406240768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1218us (2478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834188.577180:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787834188.577365:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787834188.577381:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834188.577390:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834188.577453:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834188.577486:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834188.577519:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834188.577567:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406240896 00000100:00100000:0.0:1787834188.577573:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406240896 00000100:00100000:0.0:1787834188.577609:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787834188.577618:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:22703:x1874679406240896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834188.577725:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:22703:x1874679406240896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834188.577740:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787834188.578093:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406240896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834188.578128:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406241024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787834188.578174:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834188.578199:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834188.578432:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406241024 00000100:00100000:1.0:1787834188.578436:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406241024 00000100:00100000:1.0:1787834188.578473:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787834188.578479:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:22703:x1874679406241024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787834188.578565:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:22703:x1874679406241024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834188.578572:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787834188.578658:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406241024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787834188.580217:0:23915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787834188.580553:0:22703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787834188.580576:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787834188.580587:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834188.580598:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834188.950328:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834189.531815:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787834189.974984:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834190.678626:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406241152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834190.678705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787834190.678961:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834190.678965:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834190.678968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834190.678970:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787834190.679916:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787834190.679927:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406241536:0@lo:400:kworker.0 00000100:00100000:0.0:1787834190.679971:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834190.680049:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406241152 00000100:00100000:0.0:1787834190.680057:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406241152 00000100:00100000:0.0:1787834190.680101:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787834190.680111:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406241152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787834190.680146:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834190.680197:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1874679406241152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834190.680204:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787834190.680233:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406241280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834190.680263:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834190.680283:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787834190.680289:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406241408:0@lo:400:kworker.0 00000100:00100000:0.0:1787834190.680328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834190.680370:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406241280 00000100:00100000:0.0:1787834190.680374:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406241280 00000100:00100000:0.0:1787834190.680395:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787834190.680402:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406241280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787834190.680420:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787834190.680455:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406241280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834190.680471:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787834190.680496:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406241408 00000100:00100000:0.0:1787834190.680501:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406241408 00000100:00100000:0.0:1787834190.680531:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787834190.680538:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+18:3640:x1874679406241408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834190.680570:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+18:3640:x1874679406241408:12345-0@lo:400:kworker.0 Request processed in 33us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834190.680576:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787834190.680621:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406241408:0@lo:400:kworker.0 00000100:00100000:0.0:1787834190.680637:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406241280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834190.680667:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406241152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787834190.680746:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406241536 00000100:00100000:1.0:1787834190.680932:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406241536 00000100:00100000:0.0:1787834190.681071:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834190.681080:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406241536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834190.681124:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406241536:12345-0@lo:400:kworker.0 Request processed in 47us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834190.681132:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787834190.681200:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df50568ed00 x1874679406241536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834190.681211:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406241536:0@lo:400:kworker.0 00000100:00080000:2.0:1787834190.686135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834190.686146:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834190.686149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834190.686152:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787834190.686235:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406241664:0@lo:400:kworker.0 00000100:00100000:0.0:1787834190.686439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834190.686569:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406241664 00000100:00100000:1.0:1787834190.686577:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406241664 00000100:00100000:1.0:1787834190.686628:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834190.686637:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406241664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834190.692770:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406241664:12345-0@lo:400:kworker.0 Request processed in 6111us (6308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834190.692788:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787834190.693127:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df50568d680 x1874679406241664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834190.693160:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406241664:0@lo:400:kworker.0 00000100:00100000:1.0:1787834190.742829:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834180/real 1787834180] req@ffff8df636ad5e00 x1874679406235264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834190 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834190.742863:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df636ad5e00 x1874679406235264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834190 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834190.742875:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834180/real 1787834180] req@ffff8df60e120f00 x1874679406235008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834190 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834190.742886:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df60e120f00 x1874679406235008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834190 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787834190.742906:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df620707000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834190.742957:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834190.742961:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406235264:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787834190.742967:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6359bb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834190.742973:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834190.742976:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406235008:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787834190.743082:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834190.743087:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834190.743090:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834190.743092:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834190.743095:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834190.743098:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787834190.743101:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df6359bb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834190.743106:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 656 00000100:00080000:3.0:1787834190.743111:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787834190.743118:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df6359bb000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834190.743151:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e121e00 x1874679406241792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787834190.743174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834190.743177:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787834190.743179:0:37:0:(import.c:65:import_set_state_nolock()) ffff8df620707000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834190.743182:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 656 00000100:00080000:3.0:1787834190.743185:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787834190.743188:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df620707000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834190.743199:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df60e120780 x1874679406241920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787834190.743562:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406241792:0@lo:8:kworker.0 00000400:00000100:1.0:1787834190.743614:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406241792 offset 0 length 520: 4 00000100:00100000:1.0:1787834190.743648:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e120780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406241920:0@lo:8:kworker.0 00000400:00000100:1.0:1787834190.743681:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406241920 offset 0 length 520: 4 00010000:00010000:0.0:1787834190.999613:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787834191.198674:0:23436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787834191.765975:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834176/real 1787834176] req@ffff8df6359d9a40 x1874679406233088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834191 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834191.766009:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df6359d9a40 x1874679406233088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834191 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834191.766020:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834176/real 1787834176] req@ffff8df6359d8f00 x1874679406233216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834191 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834191.766033:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df6359d8f00 x1874679406233216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834191 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787834191.766053:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df504686000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834191.766079:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834191.766084:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406233088:0@lo:8:kworker.0 00000100:00080000:1.0:1787834191.766089:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df620728000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787834191.766094:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787834191.766107:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406233216:0@lo:8:kworker.0 00000100:00080000:2.0:1787834191.766587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834191.766592:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787834191.766595:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df504686000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787834191.766600:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:2.0:1787834191.766605:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787834191.766623:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df504686000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834191.766642:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50568ed00 x1874679406242304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787834191.766655:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834191.766658:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787834191.766660:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df620728000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787834191.766662:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:2.0:1787834191.766664:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787834191.766668:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df620728000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834191.766677:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50568fc00 x1874679406242432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787834191.766705:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834191.766708:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834191.766711:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834191.766714:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787834191.766736:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406242560:0@lo:400:kworker.0 00000100:00100000:0.0:1787834191.767014:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406242048:0@lo:400:kworker.0 00000100:00100000:1.0:1787834191.767415:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406242176:0@lo:400:kworker.0 00000100:00100000:3.0:1787834191.769016:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406242688:0@lo:400:kworker.0 00000100:00100000:0.0:1787834191.769332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834191.769382:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406242816:0@lo:400:kworker.0 00000100:00100000:0.0:1787834191.769413:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834191.769451:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406242048 00000100:00100000:0.0:1787834191.769458:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406242048 00000100:00100000:1.0:1787834191.769482:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834191.769519:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787834191.769530:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:3640:x1874679406242048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834191.769583:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:3640:x1874679406242048:12345-0@lo:400:kworker.0 Request processed in 55us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834191.769590:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406242816 00000100:00100000:0.0:1787834191.769593:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787834191.769596:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406242816 00000100:00100000:1.0:1787834191.769628:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787834191.769637:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406242816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834191.769688:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406242816:12345-0@lo:400:kworker.0 Request processed in 53us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834191.769696:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787834191.769711:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406242048:0@lo:400:kworker.0 00000100:00100000:1.0:1787834191.769717:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406242176 00000100:00100000:1.0:1787834191.769722:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406242176 00010000:00080000:0.0:1787834191.769730:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df50568f480 x1874679406242816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834191.769741:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406242816:0@lo:400:kworker.0 00000100:00100000:1.0:1787834191.769915:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787834191.769922:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406242176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834191.769963:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406242176:12345-0@lo:400:kworker.0 Request processed in 41us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834191.769969:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787834191.769994:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406242304:0@lo:8:kworker.0 00000400:00000100:1.0:1787834191.770034:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406242304 offset 0 length 520: 4 00000100:00100000:1.0:1787834191.770295:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406242432:0@lo:8:kworker.0 00000100:00100000:2.0:1787834191.770312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:1.0:1787834191.770336:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679406242432 offset 0 length 520: 4 00000100:00100000:1.0:1787834191.770373:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406242176:0@lo:400:kworker.0 00000100:00100000:3.0:1787834191.771327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834191.771427:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406242688 00000100:00100000:2.0:1787834191.771441:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406242688 00000100:00100000:2.0:1787834191.771734:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787834191.771744:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406242688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834191.771955:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406242688:12345-0@lo:400:kworker.0 Request processed in 213us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834191.771964:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787834191.772096:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406242688:0@lo:400:kworker.0 00000100:00100000:0.0:1787834191.772170:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406242560 00000100:00100000:0.0:1787834191.772175:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406242560 00000100:00100000:0.0:1787834191.772257:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787834191.772265:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406242560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834191.774523:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406242560:12345-0@lo:400:kworker.0 Request processed in 2250us (4215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834191.774547:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787834191.775121:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df50568cb40 x1874679406242560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834191.775136:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406242560:0@lo:400:kworker.0 00010000:00010000:1.0:1787834192.022336:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787834192.854675:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787834193.046980:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787834194.003518:0:24204:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787834194.003521:0:24204:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787834194.003523:0:24204:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787834194.003696:0:24204:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df6071e9800 00000020:01000004:3.0:1787834194.003712:0:24204:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787834194.003724:0:24204:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787834194.003737:0:24204:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8df503f11a48) 00000020:00000080:3.0:1787834194.003827:0:24204:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1787834194.069889:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787834194.071108:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787834194.073942:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787834194.074307:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787834194.074739:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787834194.074992:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787834194.075271:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787834194.075514:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1787834194.079335:0:24204:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787834194.079549:0:24204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787834194.079562:0:24204:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787834194.079574:0:24204:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x996d2fb20dc1eeca 00000020:01000004:2.0:1787834194.079644:0:24204:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787834194.079665:0:24204:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787834194.079668:0:24204:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787834194.079674:0:24204:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787834194.079678:0:24204:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787834194.079689:0:24204:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8df62ea93490) 00000020:00000080:2.0:1787834194.079700:0:24204:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787834194.080946:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787834194.081096:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787834194.081102:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787834194.083323:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787834194.083337:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787834194.083892:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787834194.083900:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787834194.092637:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834194.092829:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787834194.092835:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787834194.097302:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787834194.097314:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787834194.117355:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787834194.117676:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787834194.117682:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787834194.120515:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787834194.120530:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787834194.122984:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787834194.122999:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787834194.126544:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787834194.126907:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787834194.126914:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787834194.128087:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787834194.128096:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787834194.179600:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787834194.179825:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787834194.179833:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787834194.182783:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787834194.182797:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787834194.195790:0:24204:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787834194.195827:0:24204:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787834194.195833:0:24204:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787834194.239235:0:24204:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787834194.239277:0:24204:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787834194.239282:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787834194.239293:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787834194.239295:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834194.239296:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834194.239297:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834194.239298:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834194.239300:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787834194.239301:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834194.239302:0:24204:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787834194.239305:0:24204:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787834194.239308:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787834194.239314:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787834194.239315:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834194.239316:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834194.239317:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834194.239319:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834194.239320:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787834194.239321:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834194.239322:0:24204:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787834194.239359:0:24204:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787834194.239378:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406242944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787834194.239446:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834194.239528:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504d50f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787834194.244453:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406242944 00000100:00100000:1.0:1787834194.244469:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406242944 00000100:00100000:0.0:1787834194.249332:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787834194.249349:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:24204:x1874679406242944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787834194.249385:0:22698:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787834194.249388:0:22698:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787834194.249392:0:22698:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787834194.249881:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:24204:x1874679406242944:12345-0@lo:253:mount.lustre.0 Request processed in 536us (10433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.249890:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787834194.250005:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406242944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787834194.250019:0:24204:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787834194.250022:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787834194.250024:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787834194.250025:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787834194.250027:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787834194.250028:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787834194.250029:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787834194.250031:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787834194.250032:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787834194.250034:0:24204:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787834194.250053:0:24204:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df6071e9800 from lustre-OST0000 10000000:01000000:1.0:1787834194.250083:0:24204:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787834194.250086:0:24204:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787834194.250093:0:24204:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df62ea91a48 local copy 00010000:00010000:1.0:1787834194.250103:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834194.250216:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834194.250252:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.250991:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834194.251046:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406243072 00000100:00100000:2.0:1787834194.251065:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406243072 00000100:00100000:2.0:1787834194.251099:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787834194.251107:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:24204:x1874679406243072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834194.251209:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+18:24204:x1874679406243072:12345-0@lo:501:mount.lustre.0 Request processed in 102us (956us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787834194.251216:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787834194.251545:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243072:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787834194.251565:0:24204:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787834194.251599:0:24204:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787834194.251608:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.251624:0:24204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834194.251654:0:24204:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df6071e9800 10000000:01000000:1.0:1787834194.251659:0:24204:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787834194.251664:0:24204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787834194.251667:0:24204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787834194.251671:0:24204:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787834194.251674:0:24204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787834194.251701:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3a000/0x996d2fb20dc1eed8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.251709:0:24204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3a000/0x996d2fb20dc1eed8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.251716:0:24204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3a000/0x996d2fb20dc1eed8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834194.251731:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834194.251794:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.251814:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df502e730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834194.251921:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406243200 00000100:00100000:0.0:1787834194.251925:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406243200 00000100:00100000:0.0:1787834194.251951:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787834194.251958:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+18:24204:x1874679406243200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834194.251967:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834194.251980:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504676000/0x996d2fb20dc1eedf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1eed8 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834194.252002:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504676000/0x996d2fb20dc1eedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1eed8 expref: 19 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834194.252024:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504676000/0x996d2fb20dc1eedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1eed8 expref: 19 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834194.252033:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504676000, rc 0) 00000100:00100000:0.0:1787834194.252076:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243200:12345-0@lo:101:mount.lustre.0 Request processed in 119us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.252083:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787834194.252256:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834194.252269:0:24204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3a000/0x996d2fb20dc1eed8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eedf expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.252278:0:24204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3a000/0x996d2fb20dc1eed8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1eedf expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787834194.253676:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1787834194.254544:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834194.257896:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787834194.258125:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787834194.258214:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787834194.258230:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787834194.258245:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787834194.258258:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787834194.258272:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787834194.258293:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787834194.258306:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1787834194.258316:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1787834194.258326:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1787834194.258338:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1787834194.258360:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1787834194.258365:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1787834194.258550:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834194.258685:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834194.258812:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50392e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787834194.259172:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406243328 00000100:00100000:0.0:1787834194.259180:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406243328 00000100:00100000:0.0:1787834194.259228:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787834194.259237:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834194.259419:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243328:12345-0@lo:501:mount.lustre.0 Request processed in 183us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.259437:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787834194.259707:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834194.259742:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834194.259809:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834194.259833:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503dbe180 going to sleep for 11 seconds 00000100:00100000:0.0:1787834194.259932:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406243456 00000100:00100000:0.0:1787834194.259936:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406243456 00000100:00100000:0.0:1787834194.260007:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787834194.260015:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834194.260930:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243456:12345-0@lo:503:mount.lustre.0 Request processed in 913us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.260940:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787834194.261030:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787834194.261463:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787834194.261553:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834194.261839:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834194.262405:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503dbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1787834194.262555:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406243584 00000100:00100000:2.0:1787834194.262562:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406243584 00000100:00100000:2.0:1787834194.262629:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787834194.262637:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834194.263329:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243584:12345-0@lo:502:mount.lustre.0 Request processed in 692us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834194.263344:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787834194.263450:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787834194.263688:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787834194.263716:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787834194.263734:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787834194.263783:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787834194.263803:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787834194.263818:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787834194.263832:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787834194.263846:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787834194.263861:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1787834194.263875:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1787834194.263889:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1787834194.264156:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1787834194.264192:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834194.264239:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834194.264265:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503dbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1787834194.264429:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406243712 00000100:00100000:2.0:1787834194.264435:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406243712 00000100:00100000:2.0:1787834194.264465:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787834194.264472:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834194.264570:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243712:12345-0@lo:502:mount.lustre.0 Request processed in 97us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834194.264587:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787834194.264743:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1203c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787834194.264822:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1787834194.264829:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1787834194.265844:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787834194.265853:0:24221:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787834194.265858:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.265860:0:24221:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787834194.265866:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787834194.265887:0:24221:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8df635863490) 00000020:00000080:3.0:1787834194.265919:0:24221:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787834194.265926:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787834194.266213:0:24221:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df6071e9800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787834194.266222:0:24221:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787834194.266229:0:24221:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x996d2fb20dc1eeed 00010000:00010000:3.0:1787834194.284390:0:24221:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1787834194.286347:0:24221:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1787834194.291965:0:24221:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787834194.302435:0:24221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787834194.302447:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834194.302454:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.302456:0:24221:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787834194.302459:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787834194.302462:0:24221:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787834194.302464:0:24221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787834194.302465:0:24221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787834194.302467:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787834194.302469:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.302470:0:24221:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787834194.302473:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834194.302475:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.302477:0:24221:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787834194.302480:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787834194.302481:0:24221:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787834194.302484:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834194.302485:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.302487:0:24221:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787834194.302489:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834194.302491:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.302492:0:24221:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787834194.302495:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787834194.302524:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834194.302528:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.302541:0:24221:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787834194.302544:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1787834194.303013:0:24204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787834194.303050:0:24204:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787834194.303070:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3a000/0x996d2fb20dc1eed8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eedf expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834194.303095:0:24204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3a000/0x996d2fb20dc1eed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eedf expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834194.303103:0:24204:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df6071e9800 from 1 10000000:01000000:0.0:1787834194.303106:0:24204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787834194.303150:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834194.303157:0:24204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834194.303167:0:24204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834194.303191:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787834194.303256:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834194.303304:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df63581a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834194.305560:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406243840 00000100:00100000:3.0:1787834194.305573:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406243840 00000100:00100000:3.0:1787834194.305639:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787834194.305649:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:24204:x1874679406243840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834194.305666:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834194.305682:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1eef4 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834194.305709:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1eef4 expref: 20 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834194.305739:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1eef4 expref: 20 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834194.305765:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7a00, rc 0) 00000100:00100000:3.0:1787834194.305832:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406243840:12345-0@lo:101:mount.lustre.0 Request processed in 184us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834194.305838:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787834194.306180:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834194.306198:0:24204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834194.306208:0:24204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787834194.309828:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1787834194.311277:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787834194.313548:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787834194.313588:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1787834194.313616:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1787834194.313630:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1787834194.313644:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1787834194.313659:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1787834194.313671:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1787834194.313683:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1787834194.313695:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1787834194.313707:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1787834194.313721:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1787834194.313742:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1787834194.313769:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1787834194.313986:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834194.314116:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834194.314492:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604dc0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787834194.314551:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406243968 00000100:00100000:1.0:1787834194.314559:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406243968 00000100:00100000:1.0:1787834194.314610:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787834194.314619:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406243968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834194.314939:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406243968:12345-0@lo:501:mount.lustre.0 Request processed in 320us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834194.314947:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787834194.315018:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406243968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834194.315121:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834194.315429:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834194.315462:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604dc0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787834194.315533:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406244096 00000100:00100000:3.0:1787834194.315538:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406244096 00000100:00100000:3.0:1787834194.315578:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787834194.315594:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406244096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834194.315725:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406244096:12345-0@lo:503:mount.lustre.0 Request processed in 131us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834194.315731:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787834194.319454:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244096:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787834194.320798:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787834194.321276:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834194.321424:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.321472:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787834194.321720:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406244224 00000100:00100000:3.0:1787834194.321726:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406244224 00000100:00100000:3.0:1787834194.321801:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787834194.321811:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406244224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834194.322386:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406244224:12345-0@lo:502:mount.lustre.0 Request processed in 574us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834194.322395:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787834194.322484:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834194.323093:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787834194.323126:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787834194.323151:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787834194.323163:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787834194.323175:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787834194.323187:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787834194.323197:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787834194.323208:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787834194.323219:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787834194.323230:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787834194.323241:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787834194.323268:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834194.323516:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.323547:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787834194.327061:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406244352 00000100:00100000:0.0:1787834194.327075:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406244352 00000100:00100000:0.0:1787834194.327134:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787834194.327143:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406244352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834194.327581:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406244352:12345-0@lo:502:mount.lustre.0 Request processed in 437us (4063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.327589:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787834194.327638:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834194.327721:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787834194.327736:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787834194.329055:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834194.329066:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.329068:0:24225:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787834194.329076:0:24225:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df6071e9800 00000020:00000080:3.0:1787834194.329078:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834194.329085:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834194.329088:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.329089:0:24225:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787834194.329092:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834194.329094:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.329095:0:24225:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787834194.329098:0:24225:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df6071e9800 00000020:00000080:3.0:1787834194.329099:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834194.329459:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834194.329465:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.329466:0:24225:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787834194.329469:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834194.329472:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.329473:0:24225:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834194.329476:0:24225:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df6071e9800 00000020:00000080:3.0:1787834194.329478:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834194.333980:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834194.334378:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.334381:0:24225:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787834194.334387:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787834194.334392:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.334394:0:24225:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787834194.334405:0:24225:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df6071e9800 00000020:00000080:3.0:1787834194.334408:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787834194.334471:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787834194.334475:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787834194.334477:0:24225:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787834194.334480:0:24225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787834194.340616:0:24204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787834194.340665:0:24204:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787834194.340922:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.340936:0:24204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834194.341013:0:24204:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787834194.341016:0:24204:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df6071e9800 10000000:01000000:1.0:1787834194.341019:0:24204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df6071e9800 10000000:01000000:1.0:1787834194.341033:0:24204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787834194.341040:0:24204:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df6071e9800 from 1 10000000:01000000:1.0:1787834194.341043:0:24204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787834194.341078:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b600/0x996d2fb20dc1ef02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.341086:0:24204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3b600/0x996d2fb20dc1ef02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.341097:0:24204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3b600/0x996d2fb20dc1ef02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834194.341120:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834194.341219:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.341274:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787834194.341377:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406244480 00000100:00100000:3.0:1787834194.341384:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406244480 00000100:00100000:3.0:1787834194.341435:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787834194.341443:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+20:24204:x1874679406244480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834194.341456:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834194.341469:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1ef09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ef02 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834194.341493:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1ef09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef02 expref: 21 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834194.341503:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b7e00/0x996d2fb20dc1ef09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef02 expref: 21 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834194.341512:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7e00, rc 0) 00000100:00100000:3.0:1787834194.341550:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406244480:12345-0@lo:101:mount.lustre.0 Request processed in 108us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834194.341556:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787834194.344081:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834194.344111:0:24204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3b600/0x996d2fb20dc1ef02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef09 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.344123:0:24204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3b600/0x996d2fb20dc1ef02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ef09 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787834194.347819:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787834194.351647:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787834194.351942:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787834194.351966:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787834194.351981:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787834194.351993:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787834194.352018:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787834194.352039:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787834194.352051:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787834194.352062:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787834194.352073:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787834194.352098:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787834194.352113:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787834194.352125:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787834194.352148:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787834194.352161:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787834194.352172:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787834194.352186:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787834194.352198:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787834194.352210:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787834194.352223:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787834194.352236:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787834194.352261:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787834194.352281:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787834194.352305:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787834194.352321:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787834194.352334:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787834194.352361:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787834194.352377:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787834194.352389:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787834194.352401:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787834194.352414:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787834194.352427:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787834194.352441:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787834194.352455:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787834194.352468:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787834194.352481:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787834194.352494:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787834194.352508:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787834194.352522:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787834194.352535:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787834194.352549:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787834194.352561:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787834194.356276:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787834194.356339:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787834194.356357:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787834194.356370:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787834194.356388:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787834194.356403:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787834194.356417:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787834194.356570:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787834194.358795:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787834194.359953:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787834194.359967:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787834194.360716:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834194.360806:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.360858:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787834194.362249:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406244608 00000100:00100000:0.0:1787834194.362266:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406244608 00000100:00100000:0.0:1787834194.362332:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787834194.362348:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406244608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834194.362526:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406244608:12345-0@lo:501:mount.lustre.0 Request processed in 179us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.362535:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787834194.362812:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787834194.364787:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834194.364870:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.364905:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787834194.364992:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406244736 00000100:00100000:0.0:1787834194.365012:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406244736 00000100:00100000:0.0:1787834194.365071:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787834194.365081:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406244736:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834194.365202:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406244736:12345-0@lo:503:mount.lustre.0 Request processed in 122us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.365209:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787834194.365578:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244736:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787834194.368604:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787834194.368699:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834194.368796:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.368843:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787834194.369306:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406244864 00000100:00100000:0.0:1787834194.369313:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406244864 00000100:00100000:0.0:1787834194.369364:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787834194.369373:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406244864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834194.369486:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406244864:12345-0@lo:502:mount.lustre.0 Request processed in 114us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.369494:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787834194.371870:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834194.375448:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787834194.375502:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787834194.375517:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787834194.375552:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787834194.375566:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787834194.375579:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787834194.375592:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787834194.375605:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787834194.375616:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787834194.375630:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787834194.375642:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787834194.375654:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787834194.375666:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787834194.375677:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787834194.375689:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787834194.375716:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787834194.375728:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787834194.375741:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787834194.375772:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787834194.375799:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787834194.375813:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787834194.375825:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787834194.375837:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787834194.375850:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787834194.375861:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787834194.375872:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787834194.375884:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787834194.375895:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787834194.375907:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787834194.375921:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787834194.375932:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787834194.375944:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787834194.375956:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787834194.375969:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787834194.375980:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787834194.376023:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787834194.376040:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787834194.376052:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787834194.376064:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787834194.376076:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787834194.376086:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787834194.376098:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787834194.376109:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787834194.376122:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787834194.376146:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787834194.376160:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787834194.376172:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787834194.376186:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787834194.376265:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834194.376358:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.376417:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406244992 00000100:00100000:1.0:1787834194.376423:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406244992 00000100:00100000:1.0:1787834194.376471:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787834194.376480:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406244992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834194.376602:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406244992:12345-0@lo:502:mount.lustre.0 Request processed in 122us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834194.376610:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787834194.376669:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787834194.376692:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406244992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834194.376871:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787834194.376894:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1787834194.376915:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406245120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834194.376951:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.376975:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406245120 00000100:00100000:1.0:1787834194.376978:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406245120 00000100:00100000:1.0:1787834194.377002:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787834194.377008:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406245120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834194.377067:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406245120:12345-0@lo:502:mount.lustre.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834194.377074:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787834194.377105:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787834194.377118:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406245120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834194.377154:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787834194.377161:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787834194.387515:0:24230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787834194.387532:0:24230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8df60efc8000) 00000020:00000080:1.0:1787834194.387558:0:24230:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1787834194.389904:0:24230:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df6071e9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787834194.389914:0:24230:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df6071e9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787834194.389918:0:24230:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df6071e9800 3 00010000:00080000:1.0:1787834194.389950:0:24230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df61045f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834194.392517:0:24230:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787834194.392871:0:24230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787834194.392914:0:24230:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787834194.392928:0:24230:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x996d2fb20dc1ef17 00000100:00080000:1.0:1787834194.392938:0:24230:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834194.392945:0:24230:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8df61045f000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834194.392979:0:24230:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df636ad7c00 x1874679406245248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787834194.393770:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406245248:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787834194.393839:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.393903:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406245248 00000100:00100000:1.0:1787834194.393910:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406245248 00000100:00100000:1.0:1787834194.393938:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787834194.393943:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874679406245248:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787834194.393967:0:23763:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:1.0:1787834194.395261:0:23763:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x996d2fb20dc1ef1e 00000004:00100000:1.0:1787834194.395344:0:23763:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787834194.395383:0:23763:0:(import.c:65:import_set_state_nolock()) ffff8df503c55800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834194.395460:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874679406245248:12345-0@lo:38:llog_process_th.0 Request processed in 1513us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834194.395476:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787834194.395533:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df636ad7c00 x1874679406245248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834194.395544:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787834194.395551:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1787834194.395560:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787834194.395564:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787834194.395567:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df61045f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787834194.395573:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874679406245248:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787834194.395796:0:24230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787834194.396919:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406245376:0@lo:400:kworker.0 00000100:00080000:0.0:1787834194.397779:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834194.397786:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834194.397789:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834194.397792:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787834194.397828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.397883:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406245376 00000100:00100000:1.0:1787834194.397889:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406245376 00000100:00080000:0.0:1787834194.397908:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834194.397913:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834194.397927:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1787834194.397928:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787834194.397934:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787834194.397939:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406245376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834194.397977:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406245504:0@lo:400:kworker.0 00000100:00100000:1.0:1787834194.397990:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406245376:12345-0@lo:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.398015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834194.398038:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787834194.398045:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406245632:0@lo:400:kworker.0 00000100:00100000:0.0:1787834194.398067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834194.398101:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406245504 00000100:00100000:0.0:1787834194.398106:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406245504 00000100:00100000:0.0:1787834194.398132:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787834194.398150:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406245504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834194.398192:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406245504:12345-0@lo:400:kworker.0 Request processed in 53us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.398198:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787834194.398236:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df63fcb12c0 x1874679406245504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834194.398248:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406245504:0@lo:400:kworker.0 00000100:00100000:3.0:1787834194.398685:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406245760:0@lo:400:kworker.0 00000100:00100000:3.0:1787834194.398719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.399104:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787834194.399119:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406245632 00000100:00100000:1.0:1787834194.399122:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406245632 00000100:00100000:1.0:1787834194.399383:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787834194.399391:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406245632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834194.399538:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406245760 00000100:00100000:0.0:1787834194.399543:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406245760 00000100:00100000:0.0:1787834194.399587:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787834194.399595:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e1203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406245760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834194.399640:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e1203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406245760:12345-0@lo:400:kworker.0 Request processed in 46us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834194.399647:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787834194.399681:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df63fcb0f00 x1874679406245760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834194.399701:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406245760:0@lo:400:kworker.0 00000100:00100000:1.0:1787834194.399766:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406245632:12345-0@lo:400:kworker.0 Request processed in 375us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834194.399773:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787834194.399814:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406245376:0@lo:400:kworker.0 00000100:00100000:3.0:1787834194.402728:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406245632:0@lo:400:kworker.0 00000020:01000004:3.0:1787834194.406530:0:24230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787834194.406553:0:24230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8df635861a48) 00000020:00000080:3.0:1787834194.406576:0:24230:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787834194.406679:0:24230:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df6071e9800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787834194.406683:0:24230:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df6071e9800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787834194.406685:0:24230:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df6071e9800 3 00010000:00080000:3.0:1787834194.406716:0:24230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df503fb7800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.117@tcp at head 00010000:00010000:0.0:1787834194.418845:0:24230:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787834194.419472:0:24230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787834194.419521:0:24230:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787834194.419534:0:24230:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x996d2fb20dc1ef2c 00000100:00080000:0.0:1787834194.419543:0:24230:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787834194.419549:0:24230:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8df503fb7800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1787834194.419974:0:24230:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df6359d9a40 x1874679406245888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787834194.420450:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406245888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787834194.420526:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787834194.420597:0:24230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787834194.420621:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834194.420626:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834194.420629:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834194.420632:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834194.420636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834194.420639:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787834194.420641:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787834194.420644:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787834194.423932:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406245888 00000100:00100000:3.0:1787834194.423947:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406245888 00000100:00100000:3.0:1787834194.424020:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787834194.424029:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406245888:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787834194.424099:0:22706:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:3.0:1787834194.424193:0:22706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x996d2fb20dc1ef33 00000004:00100000:3.0:1787834194.424225:0:22706:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787834194.424259:0:22706:0:(import.c:65:import_set_state_nolock()) ffff8df503fb7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834194.430736:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874679406245888:12345-0@lo:38:llog_process_th.0 Request processed in 6695us (10198us total) trans 0 rc 0/0 00010000:00080000:2.0:1787834194.430736:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8df6359d9a40 x1874679406245888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834194.430772:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787834194.430846:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787834194.430858:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787834194.430867:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787834194.430872:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787834194.430876:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df503fb7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787834194.430883:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874679406245888:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787834194.437353:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1787834194.437699:0:24204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787834194.437731:0:24204:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787834194.437777:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b600/0x996d2fb20dc1ef02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef09 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834194.437814:0:24204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3b600/0x996d2fb20dc1ef02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef09 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787834194.437874:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787834194.437877:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787834194.437879:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834194.437880:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834194.437881:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834194.437883:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834194.437884:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787834194.437886:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834194.437887:0:24204:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787834194.437891:0:24204:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787834194.437894:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787834194.437895:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787834194.437897:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834194.437898:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834194.437899:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834194.437900:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834194.437901:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787834194.438042:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834194.438044:0:24204:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787834194.438069:0:24204:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787834194.438087:0:24204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406246016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787834194.438152:0:24204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834194.438198:0:24204:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efa66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834194.438317:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406246016 00000100:00100000:1.0:1787834194.438324:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406246016 00000100:00100000:1.0:1787834194.438375:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787834194.438385:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406246016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787834194.438410:0:22700:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787834194.438424:0:22700:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787834194.450943:0:22700:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787834194.450967:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787834194.451349:0:22720:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787834194.451355:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787834194.451376:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.451399:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee7d expref: 21 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.451408:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ee8b expref: 21 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.451415:0:22720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.451451:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ee8b expref: 21 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.451464:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee8b expref: 21 pid: 22698 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834194.451484:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406246144:0@lo:104: 00000100:00100000:1.0:1787834194.451547:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834194.451618:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ee7d expref: 21 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.451628:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee7d expref: 21 pid: 22699 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834194.451636:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad6580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406246272:0@lo:104: 00000100:00100000:1.0:1787834194.451670:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834194.451697:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602df2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787834194.451866:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787834194.451883:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406246144 00000100:00100000:2.0:1787834194.451889:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406246144 00000100:00100000:2.0:1787834194.451922:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406246272 00000100:00100000:2.0:1787834194.451924:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406246272 00000100:00100000:3.0:1787834194.451949:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787834194.451960:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+4:22720:x1874679406246144:12345-0@lo:104: 00010000:00010000:3.0:1787834194.451974:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834194.452143:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:24204:x1874679406246016:12345-0@lo:253:mount.lustre.0 Request processed in 13760us (13990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834194.452153:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1787834194.457594:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787834194.457610:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+4:22720:x1874679406246144:12345-0@lo:104: Request processed in 5649us (6060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834194.457623:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787834194.457673:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787834194.457686:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406246272:12345-0@lo:104: 00010000:00010000:3.0:1787834194.457705:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834194.457773:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787834194.457778:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406246272:12345-0@lo:104: Request processed in 99us (6108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834194.458298:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787834194.459099:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406246144:0@lo:104: 00000100:00100000:0.0:1787834194.459111:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad6580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406246272:0@lo:104: 00010000:00010000:0.0:1787834194.459132:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834194.459772:0:24204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:24204:1874679406246016:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787834194.459788:0:24204:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787834194.459804:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787834194.459806:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787834194.459807:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787834194.459808:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787834194.459809:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787834194.459810:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787834194.459812:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787834194.459814:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787834194.459815:0:24204:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787834194.459826:0:24204:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787834194.461940:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834194.461951:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.461964:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3be00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:1.0:1787834194.461969:0:22694:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.461974:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787834194.461979:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787834194.461989:0:22694:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834194.462008:0:22694:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787834194.462065:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.462071:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787834194.462117:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.462125:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ee7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee84 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.462146:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834194.462148:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834194.462150:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834194.462158:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787834194.462176:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406246400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787834194.462240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834194.462318:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406246400 00000100:00100000:2.0:1787834194.462325:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406246400 00010000:00010000:2.0:1787834194.462356:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee7d expref: 21 pid: 22699 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834194.462391:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787834194.462400:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:3640:x1874679406246400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834194.462413:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834194.462418:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee7d expref: 21 pid: 22699 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.462428:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee7d expref: 21 pid: 22699 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.462443:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df504676200/0x996d2fb20dc1ee84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ee7d expref: 21 pid: 22699 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.462458:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834194.462493:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+20:3640:x1874679406246400:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834194.462500:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787834194.462597:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406246400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834194.468623:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834194.468628:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834194.468630:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834194.468901:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.468919:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834194.468923:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.468945:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834194.468951:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834194.468956:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787834194.469004:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469010:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787834194.469042:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469048:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df611a4ea00/0x996d2fb20dc1ee8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ee92 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469065:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834194.469067:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834194.469068:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834194.469248:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787834194.469267:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9903e54-1448-45ce-bd63-f50f2c84e331:3639:1874679406246528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787834194.469357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834194.469426:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406246528 00000100:00100000:2.0:1787834194.469433:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406246528 00010000:00010000:2.0:1787834194.469459:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee8b expref: 20 pid: 22698 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834194.469490:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787834194.469504:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fb91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+20:3639:x1874679406246528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834194.469517:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834194.469522:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee8b expref: 20 pid: 22698 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469533:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ee8b expref: 20 pid: 22698 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469545:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1ee92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ee8b expref: 20 pid: 22698 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469556:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469563:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787834194.469578:0:22690:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018224175s 00010000:00010000:2.0:1787834194.469583:0:22690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469589:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469595:0:22690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469600:0:22690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469604:0:22690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834194.469614:0:22690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469621:0:22690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469644:0:22690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834194.469655:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834194.469694:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fb91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:3639:x1874679406246528:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834194.469701:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787834194.469788:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9903e54-1448-45ce-bd63-f50f2c84e331:3639:1874679406246528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834194.469862:0:22720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.469871:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834194.469878:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3a800/0x996d2fb20dc1ef3a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1787834194.471026:0:24204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1787834194.476430:0:24204:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787834194.476439:0:24204:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787834194.476471:0:24204:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787834194.476521:0:24204:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787834194.476543:0:24204:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787834194.476562:0:24204:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787834194.477673:0:24204:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834194.478050:0:24204:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787834195.095249:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787834195.416544:0:24285:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834195.417155:0:24285:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1787834195.678389:0:22703:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787834195.678404:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df503c53800 from 13 10000000:01000000:1.0:1787834195.678410:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787834195.678449:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834195.678460:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834195.678472:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834195.678496:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406246656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787834195.678562:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834195.678611:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df504460900 going to sleep for 11 seconds 00000100:00100000:2.0:1787834195.678693:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406246656 00000100:00100000:2.0:1787834195.678700:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406246656 00000100:00100000:2.0:1787834195.678882:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787834195.678892:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+19:22703:x1874679406246656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834195.678906:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834195.678920:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ef41 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834195.678948:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef41 expref: 20 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834195.678959:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef41 expref: 20 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834195.678969:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f600, rc 0) 00000100:00100000:2.0:1787834195.679101:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+20:22703:x1874679406246656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834195.679109:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787834195.679177:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406246656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834195.679197:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834195.679206:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834195.679327:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406246784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787834195.679359:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834195.679413:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834195.679442:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406246784 00000100:00100000:1.0:1787834195.679447:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406246784 00000100:00100000:1.0:1787834195.679578:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787834195.679586:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+20:22703:x1874679406246784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787834195.679601:0:22700:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787834195.679618:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787834195.679621:0:22700:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1787834195.679705:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+20:22703:x1874679406246784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834195.679712:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787834195.679780:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406246784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787834195.679837:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787834195.679844:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834195.679851:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834195.679859:0:22703:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787834195.679861:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60ed4e000 from 13 10000000:01000000:0.0:1787834195.679864:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787834195.679883:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834195.679891:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834195.679898:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834195.679920:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406246912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787834195.679944:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834195.680068:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834195.680107:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406246912 00000100:00100000:2.0:1787834195.680112:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406246912 00000100:00100000:2.0:1787834195.680136:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787834195.680142:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+20:22703:x1874679406246912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834195.680150:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834195.680160:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ef4f expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834195.680175:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef4f expref: 21 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834195.680184:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef4f expref: 21 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834195.680191:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4fc00, rc 0) 00000100:00100000:2.0:1787834195.680270:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:22703:x1874679406246912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834195.680295:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787834195.680480:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406246912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834195.680492:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834195.680498:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834195.680537:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406247040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787834195.680564:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834195.680620:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6051e13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834195.680652:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406247040 00000100:00100000:2.0:1787834195.680656:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406247040 00000100:00100000:2.0:1787834195.680713:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787834195.680720:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:22703:x1874679406247040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787834195.680731:0:22699:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787834195.680742:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787834195.680745:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787834195.680836:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:22703:x1874679406247040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834195.680843:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787834195.680906:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406247040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787834195.680962:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787834195.680969:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834195.680986:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834195.797910:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787834195.797931:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406247168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834195.798001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834195.798301:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406247168 00000100:00100000:2.0:1787834195.798309:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406247168 00000100:00100000:2.0:1787834195.798368:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787834195.798379:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406247168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787834195.798412:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834195.798474:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406247168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834195.798482:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787834195.798525:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406247168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834195.799500:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406247296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834195.799547:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834195.799637:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406247296 00000100:00100000:3.0:1787834195.799644:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406247296 00000100:00100000:3.0:1787834195.799687:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787834195.799697:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406247296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787834195.799721:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787834195.799842:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406247296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834195.799851:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787834195.799909:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406247296:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787834196.118829:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834197.141889:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834198.168402:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834199.195266:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834199.767222:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1787834199.896542:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834199.896559:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834199.896561:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834199.896564:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834199.896581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834199.896584:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787834199.896587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834199.896590:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787834199.896664:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406247808:0@lo:400:kworker.0 00000100:00100000:0.0:1787834199.896954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834199.897014:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787834199.897021:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406247424:0@lo:400:kworker.0 00000100:00100000:0.0:1787834199.897050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834199.897085:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406247936:0@lo:400:kworker.0 00000100:00100000:0.0:1787834199.897111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834199.897141:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406247936 00000100:00100000:0.0:1787834199.897148:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406247936 00000100:00100000:0.0:1787834199.897190:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787834199.897198:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406247936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834199.897264:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406247936:12345-0@lo:400:kworker.0 Request processed in 66us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834199.897271:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787834199.897310:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df636ad6d00 x1874679406247936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834199.897323:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406247936:0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.897634:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406247552:0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.897666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834199.897703:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406248064:0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.897741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834199.897787:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787834199.897793:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406247680:0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.897816:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834199.897835:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406248192:0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.897856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834199.897888:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406248064 00000100:00100000:2.0:1787834199.897892:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406248064 00000100:00100000:2.0:1787834199.897920:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406247680 00000100:00100000:2.0:1787834199.897923:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406247680 00000100:00100000:2.0:1787834199.897934:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406248192 00000100:00100000:2.0:1787834199.897936:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406248192 00000100:00100000:2.0:1787834199.897952:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787834199.897958:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406248064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.897994:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406248064:12345-0@lo:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834199.898000:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787834199.898013:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787834199.898018:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406247680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.898044:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406247680:12345-0@lo:400:kworker.0 Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834199.898049:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787834199.898061:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787834199.898066:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406248192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.898092:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406248192:12345-0@lo:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834199.898107:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787834199.898138:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df636ad70c0 x1874679406247680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834199.898148:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406247680:0@lo:400:kworker.0 00010000:00080000:2.0:1787834199.898159:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df636ad61c0 x1874679406248192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834199.898167:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406248192:0@lo:400:kworker.0 00010000:00080000:2.0:1787834199.898175:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df636ad4780 x1874679406248064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834199.898182:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406248064:0@lo:400:kworker.0 00000100:00100000:0.0:1787834199.898314:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406247808 00000100:00100000:0.0:1787834199.898319:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406247808 00000100:00100000:0.0:1787834199.898410:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406247552 00000100:00100000:0.0:1787834199.898413:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406247552 00000100:00100000:0.0:1787834199.898425:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787834199.898431:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406247808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834199.898560:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406247808:12345-0@lo:400:kworker.0 Request processed in 119us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834199.898566:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787834199.898579:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787834199.898586:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406247552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834199.898616:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406247552:12345-0@lo:400:kworker.0 Request processed in 31us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834199.898622:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787834199.898659:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787834199.898663:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787834199.898852:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406247424 00000100:00100000:1.0:1787834199.898856:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406247424 00000100:00100000:1.0:1787834199.898888:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787834199.898895:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:3640:x1874679406247424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834199.898931:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:3640:x1874679406247424:12345-0@lo:400:kworker.0 Request processed in 36us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834199.898937:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787834199.899103:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406247552:0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.899129:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406247424:0@lo:400:kworker.0 00000100:00100000:2.0:1787834199.899139:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406247808:0@lo:400:kworker.0 00010000:00010000:0.0:1787834200.213993:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787834200.544860:0:24575:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787834200.918030:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787834200.918052:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406248320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834200.918120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834200.918168:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406248320 00000100:00100000:0.0:1787834200.918177:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406248320 00000100:00100000:0.0:1787834200.918236:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787834200.918255:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e121a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406248320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787834200.918290:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787834200.918338:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e121a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406248320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834200.918345:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787834200.918559:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406248320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834200.918781:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787834200.918792:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406248448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834200.918835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834200.918861:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406248448 00000100:00100000:0.0:1787834200.918865:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406248448 00000100:00100000:0.0:1787834200.918893:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787834200.918900:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406248448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787834200.918920:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834200.918965:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406248448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834200.918971:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787834200.919000:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406248448:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787834201.239255:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787834201.568292:0:24629:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787834201.568492:0:24629:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787834202.080561:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787834202.262906:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787834202.445348:0:24680:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787834202.445558:0:24680:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787834203.286021:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834204.313366:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787834205.014052:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834205.014059:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834205.014062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834205.014065:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834205.014091:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834205.014108:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834205.014111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834205.014113:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787834205.014163:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406248832:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.014171:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406248576:0@lo:400:kworker.0 00000100:00100000:1.0:1787834205.014249:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406248704:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.017878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834205.017943:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406249088:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.017985:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834205.018036:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406248576 00000100:00100000:3.0:1787834205.018044:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406248576 00000100:00100000:3.0:1787834205.018106:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787834205.018115:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:3638:x1874679406248576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.018179:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:3638:x1874679406248576:12345-0@lo:400:kworker.0 Request processed in 64us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834205.018186:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787834205.018255:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406249088 00000100:00100000:3.0:1787834205.018259:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406249088 00000100:00100000:3.0:1787834205.018288:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834205.018308:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e121680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406249088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.018342:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e121680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406249088:12345-0@lo:400:kworker.0 Request processed in 35us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834205.018349:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834205.018398:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406248576:0@lo:400:kworker.0 00010000:00080000:3.0:1787834205.018414:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250b840 x1874679406249088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834205.018426:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406249088:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.019656:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406248960:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.019777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834205.020273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834205.020307:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406248832 00000100:00100000:2.0:1787834205.020314:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406248832 00000100:00100000:2.0:1787834205.020352:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787834205.020360:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406248832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.020405:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406248832:12345-0@lo:400:kworker.0 Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834205.020412:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787834205.020451:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250b0c0 x1874679406248832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834205.020465:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406248832:0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.020473:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406249344:0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.020496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834205.020639:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406249344 00000100:00100000:3.0:1787834205.020643:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406249344 00000100:00100000:3.0:1787834205.020702:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787834205.020710:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406249344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.020746:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406249344:12345-0@lo:400:kworker.0 Request processed in 37us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834205.020796:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787834205.021410:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787834205.021439:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250b480 x1874679406249344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834205.021451:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406249344:0@lo:400:kworker.0 00000100:00100000:1.0:1787834205.021803:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406248960 00000100:00100000:1.0:1787834205.021809:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406248960 00000100:00100000:1.0:1787834205.021853:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787834205.021861:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e123c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406248960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834205.021920:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e123c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406248960:12345-0@lo:400:kworker.0 Request processed in 59us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834205.021927:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787834205.021950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834205.021976:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406249216:0@lo:400:kworker.0 00000100:00100000:1.0:1787834205.022004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834205.022031:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406248704 00000100:00100000:1.0:1787834205.022035:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406248704 00000100:00100000:1.0:1787834205.022052:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787834205.022069:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406248704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834205.022109:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406248704:12345-0@lo:400:kworker.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834205.022119:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787834205.022142:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406248704:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.022149:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406248960:0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.023879:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406249216 00000100:00100000:2.0:1787834205.023890:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406249216 00000100:00100000:2.0:1787834205.023950:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787834205.023967:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406249216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.024049:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406249216:12345-0@lo:400:kworker.0 Request processed in 85us (2044us total) trans 0 rc 0/0 00000100:00080000:0.0:1787834205.024428:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787834205.024480:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787834205.024632:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502509a40 x1874679406249216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834205.024647:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406249216:0@lo:400:kworker.0 00010000:00010000:0.0:1787834205.342977:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834205.719485:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834190/real 1787834190] req@ffff8df60e121e00 x1874679406241792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834205 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834205.719574:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df60e121e00 x1874679406241792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834205 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834205.719587:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834190/real 1787834190] req@ffff8df60e120780 x1874679406241920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834205 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834205.719601:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df60e120780 x1874679406241920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834205 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787834205.719622:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6359bb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787834205.719641:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787834205.719647:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406241792:0@lo:8:kworker.0 00000100:00080000:3.0:1787834205.719652:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df620707000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787834205.719658:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787834205.719661:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e120780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406241920:0@lo:8:kworker.0 00000100:00080000:2.0:1787834205.721983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834205.722008:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834205.722011:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834205.722013:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787834205.722043:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834205.722056:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787834205.722060:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df6359bb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787834205.722067:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:2.0:1787834205.722083:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787834205.722090:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8df6359bb000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834205.722125:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df50250a1c0 x1874679406249984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787834205.722153:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787834205.722156:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787834205.722184:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df620707000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787834205.722214:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:2.0:1787834205.722256:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787834205.722261:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df620707000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834205.722307:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502509e00 x1874679406250112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787834205.722374:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406249728:0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.722439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834205.722469:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406250496:0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.722491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834205.722511:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787834205.722516:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406249600:0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.722540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834205.722555:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406250368:0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.722574:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834205.722604:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406249728 00000100:00100000:2.0:1787834205.722611:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406249728 00000100:00100000:2.0:1787834205.722650:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406250496 00000100:00100000:2.0:1787834205.722654:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406250496 00000100:00100000:2.0:1787834205.722666:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406250368 00000100:00100000:2.0:1787834205.722669:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406250368 00000100:00100000:2.0:1787834205.722684:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787834205.722692:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406249728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.722740:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406249728:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834205.722747:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787834205.722786:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787834205.722792:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406250496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.722831:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406250496:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834205.722838:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787834205.722850:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787834205.722856:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406250368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.722881:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406250368:12345-0@lo:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834205.722887:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787834205.722923:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502508780 x1874679406250368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834205.722935:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406250368:0@lo:400:kworker.0 00010000:00080000:2.0:1787834205.722945:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df5025092c0 x1874679406249728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834205.722953:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406249728:0@lo:400:kworker.0 00010000:00080000:2.0:1787834205.722960:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502509680 x1874679406250496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834205.722967:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406250496:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.723046:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406249472:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.723081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834205.723115:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406250240:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.723145:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834205.723164:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787834205.723170:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406249856:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.723193:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834205.723234:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406249984:0@lo:8:kworker.0 00000100:00100000:3.0:1787834205.723261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834205.723280:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406250112:0@lo:8:kworker.0 00000100:00100000:3.0:1787834205.723301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834205.723326:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406250240 00000100:00100000:3.0:1787834205.723330:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406250240 00000100:00100000:3.0:1787834205.723357:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787834205.723363:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406250240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.723398:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e120780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406250240:12345-0@lo:400:kworker.0 Request processed in 35us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834205.723404:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787834205.723429:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406249600 00000100:00100000:3.0:1787834205.723433:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406249600 00000100:00100000:3.0:1787834205.723448:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406249856 00000100:00100000:3.0:1787834205.723451:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406249856 00000100:00100000:3.0:1787834205.723462:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787834205.723468:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406249600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.723504:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406249600:12345-0@lo:400:kworker.0 Request processed in 35us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834205.723510:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787834205.723522:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787834205.723527:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e121e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406249856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.723567:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e121e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406249856:12345-0@lo:400:kworker.0 Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834205.723572:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787834205.723603:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406249600:0@lo:400:kworker.0 00000100:00100000:3.0:1787834205.723626:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406249856:0@lo:400:kworker.0 00010000:00080000:3.0:1787834205.723636:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502508f00 x1874679406250240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834205.723644:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406250240:0@lo:400:kworker.0 00000100:00100000:1.0:1787834205.723941:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406249984 00000100:00100000:1.0:1787834205.723947:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406249984 00000100:00100000:1.0:1787834205.724001:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406250112 00000100:00100000:1.0:1787834205.724005:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406250112 00000100:00100000:1.0:1787834205.724018:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787834205.724023:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406249984:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787834205.724047:0:24209:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:1.0:1787834205.724074:0:24209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1ef5d 00002000:00100000:1.0:1787834205.724086:0:24209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8df60ef74000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787834205.724090:0:24209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787834205.724099:0:24209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787834205.724282:0:24209:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787834205.724303:0:24209:0:(import.c:65:import_set_state_nolock()) ffff8df60ef76000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834205.724346:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874679406249984:12345-0@lo:8:kworker.0 Request processed in 322us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834205.724352:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787834205.724367:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787834205.724372:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e122580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406250112:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787834205.724386:0:24209:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787834205.725409:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406249472 00000100:00100000:2.0:1787834205.725419:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406249472 00000100:00100000:2.0:1787834205.725501:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787834205.725510:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+21:3641:x1874679406249472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834205.725571:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+21:3641:x1874679406249472:12345-0@lo:400:kworker.0 Request processed in 63us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834205.725591:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1787834205.730929:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df50250a1c0 x1874679406249984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787834225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834205.730946:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787834205.730956:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787834205.730964:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787834205.730971:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787834205.730974:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6359bb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787834205.730996:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787834205.731003:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406249984:0@lo:8:kworker.0 00000100:00100000:3.0:1787834205.731832:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406249472:0@lo:400:kworker.0 00000100:00100000:0.0:1787834205.733505:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406250624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787834205.733597:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787834205.733668:0:23446:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787834205.733707:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1874679406250752:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787834205.733813:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834205.734072:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406250624 00000100:00100000:3.0:1787834205.734090:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406250624 00000100:00100000:3.0:1787834205.734228:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834205.734239:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874679406250624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787834205.734295:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834205.734438:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834205.734458:0:24210:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787834205.734465:0:24210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787834205.734562:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406250752 00000100:00100000:2.0:1787834205.734566:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406250752 00000100:00100000:2.0:1787834205.734654:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787834205.734662:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23446:x1874679406250752:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:2.0:1787834205.738023:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787834205.739243:0:24845:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787834205.739251:0:24845:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787834205.739347:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23446:x1874679406250752:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4683us (5530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834205.739358:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787834205.739412:0:23446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df5025092c0 x1874679406250752/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787834221 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834205.739680:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1874679406250752:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787834205.739694:0:23446:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787834205.739732:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1874679406250880:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787834205.740237:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874679406250624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5998us (6638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834205.740247:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787834205.741710:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834205.741771:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834205.741799:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406250880 00000100:00100000:2.0:1787834205.741806:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406250880 00000100:00100000:2.0:1787834205.741858:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787834205.741866:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23446:x1874679406250880:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787834205.741898:0:24845:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787834205.741944:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23446:x1874679406250880:12345-0@lo:5:osp-pre-0-1.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834205.741951:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787834205.741989:0:23446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df5025092c0 x1874679406250880/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787834221 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834205.742003:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1874679406250880:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787834205.742014:0:23446:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00010000:00080000:0.0:1787834205.742308:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502509680 x1874679406250624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834205.742326:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406250624:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1787834205.744842:0:23445:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787834205.744951:0:23445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 681658199996ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787834205.744959:0:23445:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787834205.752333:0:23436:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787834205.755248:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e122580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406250112:12345-0@lo:8:kworker.0 Request processed in 30867us (31937us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787834205.755264:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787834205.755302:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df620707000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787834205.755309:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787834205.755314:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406250112:0@lo:8:kworker.0 00000100:00100000:0.0:1787834206.039162:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787834206.039184:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406251008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834206.039257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834206.042936:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406251136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834206.043015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834206.043087:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406251008 00000100:00100000:0.0:1787834206.043094:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406251008 00000100:00100000:0.0:1787834206.043128:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406251136 00000100:00100000:0.0:1787834206.043303:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406251136 00000100:00100000:0.0:1787834206.043327:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787834206.043335:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406251008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787834206.043367:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834206.043416:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406251008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834206.043423:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787834206.043440:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787834206.043446:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406251136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787834206.043461:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787834206.043515:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406251136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834206.043520:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787834206.043567:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406251008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834206.043600:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406251136:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787834206.359929:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834207.381934:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834208.407359:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787834208.878024:0:25025:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787834208.878028:0:25025:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787834208.878042:0:25025:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787834208.878220:0:25025:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8df503fe1800 00000020:01000004:2.0:1787834208.878236:0:25025:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787834208.878248:0:25025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787834208.878263:0:25025:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8df60ec73490) 00000020:00000080:2.0:1787834208.878281:0:25025:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787834209.011902:0:25025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787834209.014545:0:25025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787834209.015278:0:25025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787834209.017773:0:25025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787834209.018065:0:25025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787834209.018841:0:25025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787834209.019139:0:25025:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1787834209.022644:0:25025:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787834209.023072:0:25025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787834209.023093:0:25025:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787834209.023105:0:25025:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x996d2fb20dc1ef6b 00000020:01000004:2.0:1787834209.023112:0:25025:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787834209.023133:0:25025:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787834209.023136:0:25025:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787834209.023142:0:25025:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787834209.023245:0:25025:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787834209.023249:0:25025:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787834209.066687:0:25025:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787834209.066879:0:25025:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.117@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787834209.066884:0:25025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787834209.066886:0:25025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834209.066887:0:25025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834209.066889:0:25025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834209.066896:0:25025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834209.066897:0:25025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834209.066898:0:25025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834209.066900:0:25025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834209.066901:0:25025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787834209.066905:0:25025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787834209.066907:0:25025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787834209.066908:0:25025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834209.066909:0:25025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834209.066909:0:25025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834209.066910:0:25025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834209.066911:0:25025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834209.066912:0:25025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834209.066913:0:25025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834209.066914:0:25025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787834209.066939:0:25025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787834209.066958:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1221c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787834209.067026:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.069436:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787834209.069559:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406251264 00000100:00100000:1.0:1787834209.069568:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406251264 00000100:00100000:1.0:1787834209.069624:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787834209.069633:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:25025:x1874679406251264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787834209.069666:0:22700:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787834209.069669:0:22700:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787834209.069672:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787834209.070681:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:25025:x1874679406251264:12345-0@lo:253:mount.lustre.0 Request processed in 1045us (3651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834209.070691:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787834209.070844:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1221c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251264:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787834209.070857:0:25025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787834209.070860:0:25025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787834209.070861:0:25025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787834209.070863:0:25025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834209.070864:0:25025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834209.070865:0:25025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834209.070866:0:25025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834209.070880:0:25025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787834209.070882:0:25025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834209.070883:0:25025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787834209.070900:0:25025:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8df503fe1800 from lustre-OST0001 10000000:01000000:0.0:1787834209.070926:0:25025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787834209.070930:0:25025:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787834209.070937:0:25025:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8df62ea91a48 local copy 00010000:00010000:0.0:1787834209.070948:0:25025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834209.071054:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834209.071091:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.071124:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ffd2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.071266:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406251392 00000100:00100000:3.0:1787834209.071272:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406251392 00000100:00100000:3.0:1787834209.071305:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787834209.071313:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:25025:x1874679406251392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834209.071377:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:25025:x1874679406251392:12345-0@lo:501:mount.lustre.0 Request processed in 66us (286us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787834209.071384:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787834209.071534:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251392:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787834209.071546:0:25025:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787834209.071572:0:25025:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787834209.071578:0:25025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834209.071587:0:25025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4f400/0x996d2fb20dc1ec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ec8c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834209.071614:0:25025:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8df503fe1800 10000000:01000000:0.0:1787834209.071618:0:25025:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787834209.071622:0:25025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787834209.071624:0:25025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787834209.071628:0:25025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787834209.071630:0:25025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787834209.071649:0:25025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676400/0x996d2fb20dc1ef72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834209.071667:0:25025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504676400/0x996d2fb20dc1ef72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834209.071677:0:25025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504676400/0x996d2fb20dc1ef72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834209.071690:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787834209.071716:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.071739:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ffd2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.071877:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406251520 00000100:00100000:3.0:1787834209.071881:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406251520 00000100:00100000:3.0:1787834209.071907:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787834209.071913:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:25025:x1874679406251520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834209.071921:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834209.071931:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ef79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ef72 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.071959:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ef79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef72 expref: 22 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.071969:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6c00/0x996d2fb20dc1ef79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef72 expref: 22 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.071977:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6c00, rc 0) 00000100:00100000:3.0:1787834209.072000:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406251520:12345-0@lo:101:mount.lustre.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.072006:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787834209.072283:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787834209.072295:0:25025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504676400/0x996d2fb20dc1ef72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef79 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834209.072304:0:25025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504676400/0x996d2fb20dc1ef72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ef79 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787834209.073644:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1787834209.074381:0:25025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787834209.080283:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787834209.080346:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787834209.080360:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787834209.080374:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787834209.080387:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787834209.080399:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787834209.080413:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787834209.080425:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787834209.080437:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1787834209.080462:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1787834209.080468:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1787834209.080573:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834209.080641:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834209.080689:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787834209.080880:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406251648 00000100:00100000:0.0:1787834209.080888:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406251648 00000100:00100000:0.0:1787834209.080938:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787834209.080947:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406251648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834209.081090:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406251648:12345-0@lo:501:mount.lustre.0 Request processed in 144us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834209.081098:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787834209.081359:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787834209.081393:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834209.081436:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834209.082090:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787834209.085347:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406251776 00000100:00100000:1.0:1787834209.085361:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406251776 00000100:00100000:1.0:1787834209.085422:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787834209.085432:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406251776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834209.086416:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406251776:12345-0@lo:503:mount.lustre.0 Request processed in 982us (4975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834209.086426:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787834209.086533:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787834209.087295:0:25025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787834209.087380:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834209.087433:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834209.087520:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.088971:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406251904 00000100:00100000:3.0:1787834209.088981:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406251904 00000100:00100000:3.0:1787834209.089039:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787834209.089047:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406251904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834209.089678:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406251904:12345-0@lo:502:mount.lustre.0 Request processed in 629us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.089687:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787834209.091217:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406251904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787834209.091453:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787834209.091484:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787834209.091499:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787834209.091515:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787834209.091530:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787834209.091544:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787834209.091557:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787834209.091570:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787834209.091582:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1787834209.091616:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787834209.091678:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834209.091724:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787834209.091950:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406252032 00000100:00100000:1.0:1787834209.091956:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406252032 00000100:00100000:1.0:1787834209.092001:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787834209.092010:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406252032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787834209.092129:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406252032:12345-0@lo:502:mount.lustre.0 Request processed in 120us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834209.092137:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787834209.093310:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787834209.093380:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1787834209.093391:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1787834209.095324:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787834209.095335:0:25029:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787834209.095341:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.095344:0:25029:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787834209.095350:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787834209.095365:0:25029:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8df60ec70000) 00000020:00000080:2.0:1787834209.095392:0:25029:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787834209.095397:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787834209.095482:0:25029:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df503fe1800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787834209.095491:0:25029:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787834209.095498:0:25029:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x996d2fb20dc1ef87 00010000:00010000:3.0:1787834209.099965:0:25029:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1787834209.100781:0:25029:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1787834209.102355:0:25029:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787834209.109169:0:25029:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787834209.109189:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834209.109195:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.109198:0:25029:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787834209.109201:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834209.109205:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.109207:0:25029:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787834209.109210:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787834209.109212:0:25029:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787834209.109214:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834209.109216:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.109217:0:25029:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787834209.109219:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834209.109221:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.109222:0:25029:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787834209.109226:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787834209.109251:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834209.109254:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.109256:0:25029:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787834209.109259:0:25029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1787834209.111517:0:25025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787834209.111570:0:25025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787834209.111594:0:25025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676400/0x996d2fb20dc1ef72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef79 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834209.111606:0:25025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504676400/0x996d2fb20dc1ef72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef79 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834209.111615:0:25025:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df503fe1800 from 1 10000000:01000000:0.0:1787834209.111617:0:25025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787834209.111651:0:25025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834209.111660:0:25025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834209.111670:0:25025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834209.111694:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787834209.111782:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.111818:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.112502:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406252160 00000100:00100000:3.0:1787834209.112509:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406252160 00000100:00100000:3.0:1787834209.112558:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787834209.112566:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+22:25025:x1874679406252160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834209.112578:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834209.112590:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ef8e expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.112612:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef8e expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.112629:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef8e expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.112637:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b6800, rc 0) 00000100:00100000:3.0:1787834209.112690:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252160:12345-0@lo:101:mount.lustre.0 Request processed in 125us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.112697:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787834209.113074:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787834209.113090:0:25025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.113099:0:25025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787834209.115564:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1787834209.115870:0:25025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787834209.116044:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787834209.116069:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1787834209.116084:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1787834209.116098:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1787834209.116114:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1787834209.116128:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1787834209.116141:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1787834209.116388:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1787834209.116412:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1787834209.116426:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1787834209.116438:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1787834209.116457:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1787834209.116462:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1787834209.116532:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834209.116595:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.116642:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.116696:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406252288 00000100:00100000:3.0:1787834209.116703:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406252288 00000100:00100000:3.0:1787834209.116778:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787834209.116787:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834209.116885:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252288:12345-0@lo:501:mount.lustre.0 Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.116893:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787834209.117261:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787834209.117290:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787834209.117333:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.117364:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787834209.117409:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406252416 00000100:00100000:2.0:1787834209.117413:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406252416 00000100:00100000:2.0:1787834209.117447:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787834209.117462:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787834209.117546:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252416:12345-0@lo:503:mount.lustre.0 Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834209.117553:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787834209.117649:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252416:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787834209.118000:0:25025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787834209.118063:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834209.118098:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.118118:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.118350:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406252544 00000100:00100000:3.0:1787834209.118356:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406252544 00000100:00100000:3.0:1787834209.118385:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787834209.118393:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834209.118477:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252544:12345-0@lo:502:mount.lustre.0 Request processed in 85us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.118484:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787834209.118553:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787834209.118708:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787834209.118924:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1787834209.118944:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1787834209.118959:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1787834209.118973:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1787834209.118987:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1787834209.119003:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1787834209.119019:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1787834209.119960:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1787834209.119996:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1787834209.120012:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1787834209.120957:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787834209.121132:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.122136:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60780c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.129550:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406252672 00000100:00100000:3.0:1787834209.129564:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406252672 00000100:00100000:3.0:1787834209.129622:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787834209.129631:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834209.130051:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252672:12345-0@lo:502:mount.lustre.0 Request processed in 420us (8919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.130068:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787834209.130286:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6359dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787834209.130373:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787834209.130388:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787834209.134414:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834209.134427:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.134429:0:25034:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787834209.134437:0:25034:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df503fe1800 00000020:00000080:2.0:1787834209.134440:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787834209.134447:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834209.134449:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.134451:0:25034:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787834209.134453:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834209.134456:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.134457:0:25034:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787834209.134461:0:25034:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8df503fe1800 00000020:00000080:2.0:1787834209.134463:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787834209.139015:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834209.140961:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.140966:0:25034:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787834209.140976:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834209.140983:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.140984:0:25034:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787834209.140989:0:25034:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df503fe1800 00000020:00000080:2.0:1787834209.140991:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787834209.141046:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834209.141049:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.141051:0:25034:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787834209.141053:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787834209.141055:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.141057:0:25034:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787834209.141060:0:25034:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8df503fe1800 00000020:00000080:2.0:1787834209.141068:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787834209.141107:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787834209.141111:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787834209.141112:0:25034:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787834209.141116:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787834209.141340:0:25025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787834209.141378:0:25025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787834209.141399:0:25025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.141410:0:25025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834209.141461:0:25025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787834209.141464:0:25025:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8df503fe1800 10000000:01000000:1.0:1787834209.141467:0:25025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8df503fe1800 10000000:01000000:1.0:1787834209.141471:0:25025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787834209.141476:0:25025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8df503fe1800 from 1 10000000:01000000:1.0:1787834209.141479:0:25025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787834209.141518:0:25025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b200/0x996d2fb20dc1ef9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.141527:0:25025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3b200/0x996d2fb20dc1ef9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.141538:0:25025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3b200/0x996d2fb20dc1ef9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834209.141563:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787834209.141623:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834209.141669:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e181a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.141722:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406252800 00000100:00100000:3.0:1787834209.141743:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406252800 00000100:00100000:3.0:1787834209.141811:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787834209.141821:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+23:25025:x1874679406252800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787834209.141834:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834209.141846:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1efa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1ef9c expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.141868:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1efa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef9c expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.141879:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df5044b7000/0x996d2fb20dc1efa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef9c expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.141887:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df5044b7000, rc 0) 00000100:00100000:3.0:1787834209.141922:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406252800:12345-0@lo:101:mount.lustre.0 Request processed in 103us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.141929:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787834209.142272:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787834209.142289:0:25025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3b200/0x996d2fb20dc1ef9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1efa3 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.142298:0:25025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3b200/0x996d2fb20dc1ef9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1efa3 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787834209.153894:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1787834209.154223:0:25025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787834209.154451:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787834209.154477:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787834209.154492:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787834209.154520:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787834209.154535:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787834209.154549:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787834209.154561:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787834209.154573:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787834209.154594:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787834209.154606:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787834209.154617:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787834209.154628:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787834209.154638:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787834209.154650:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787834209.154662:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787834209.154675:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787834209.154687:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787834209.154698:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787834209.154708:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787834209.154772:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787834209.154791:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787834209.154804:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787834209.154817:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787834209.154830:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787834209.154841:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1787834209.154853:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1787834209.154864:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1787834209.154875:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1787834209.154888:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1787834209.154899:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1787834209.154911:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1787834209.154923:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1787834209.154934:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1787834209.154946:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1787834209.154959:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1787834209.154985:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1787834209.154999:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1787834209.155010:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1787834209.155022:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1787834209.155034:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1787834209.155048:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1787834209.155069:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1787834209.155083:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1787834209.155096:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1787834209.155107:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1787834209.155120:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1787834209.155133:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1787834209.155146:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1787834209.155262:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1787834209.155283:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1787834209.155314:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1787834209.155321:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1787834209.155410:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834209.155471:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.155518:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406252928 00000100:00100000:3.0:1787834209.155525:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406252928 00000100:00100000:3.0:1787834209.155563:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787834209.155570:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406252928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834209.155668:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406252928:12345-0@lo:501:mount.lustre.0 Request processed in 98us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.155676:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787834209.155720:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5038479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.155740:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406252928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787834209.155788:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787834209.155823:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.155843:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df5038479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834209.155953:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406253056 00000100:00100000:1.0:1787834209.155958:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406253056 00000100:00100000:1.0:1787834209.155982:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787834209.155989:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787834209.156060:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253056:12345-0@lo:503:mount.lustre.0 Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834209.156067:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787834209.170588:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787834209.171066:0:25025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787834209.171152:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834209.171235:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.171274:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406253184 00000100:00100000:3.0:1787834209.171279:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406253184 00000100:00100000:3.0:1787834209.171322:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787834209.171330:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834209.171439:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253184:12345-0@lo:502:mount.lustre.0 Request processed in 109us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.171448:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787834209.171498:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6213f3000 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.171513:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787834209.171685:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787834209.171710:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787834209.171724:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787834209.171738:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787834209.171773:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787834209.171789:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787834209.171803:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787834209.171816:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787834209.171830:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787834209.171845:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787834209.171859:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787834209.171870:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787834209.171882:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787834209.171909:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787834209.171925:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787834209.171935:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787834209.171947:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787834209.171958:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787834209.171992:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787834209.172006:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787834209.172017:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787834209.172027:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787834209.172040:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787834209.172054:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787834209.172067:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787834209.172079:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787834209.172092:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787834209.172105:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787834209.172118:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787834209.172145:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787834209.172160:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787834209.172175:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787834209.172204:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787834209.172219:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787834209.172233:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787834209.172247:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787834209.172258:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787834209.172271:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787834209.172285:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787834209.172300:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787834209.172311:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787834209.172322:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787834209.172334:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787834209.172347:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787834209.172359:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787834209.172388:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787834209.172402:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787834209.172414:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787834209.172447:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834209.172493:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.172539:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406253312 00000100:00100000:3.0:1787834209.172544:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406253312 00000100:00100000:3.0:1787834209.172574:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787834209.172581:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834209.172657:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253312:12345-0@lo:502:mount.lustre.0 Request processed in 76us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.172664:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787834209.172702:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6213f3000 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.172716:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787834209.172860:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787834209.172881:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787834209.172901:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834209.172932:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.172953:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406253440 00000100:00100000:3.0:1787834209.172956:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406253440 00000100:00100000:3.0:1787834209.172978:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787834209.172984:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787834209.173041:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253440:12345-0@lo:502:mount.lustre.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.173047:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787834209.173076:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6213f3000 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.173089:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787834209.173121:0:25025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787834209.173128:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787834209.182953:0:25039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787834209.182970:0:25039:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8df60efc9a48) 00000020:00000080:1.0:1787834209.182994:0:25039:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787834209.183099:0:25039:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df503fe1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787834209.183104:0:25039:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df503fe1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787834209.183107:0:25039:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df503fe1800 3 00010000:00080000:1.0:1787834209.183137:0:25039:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df502d4b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1787834209.190718:0:25039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787834209.191024:0:25039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787834209.191072:0:25039:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787834209.191086:0:25039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x996d2fb20dc1efb1 00000100:00080000:1.0:1787834209.191096:0:25039:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787834209.191102:0:25039:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8df502d4b800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834209.191138:0:25039:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df636ad4b40 x1874679406253568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834209.191160:0:25039:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787834209.191497:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406253568:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787834209.191567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.191625:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406253568 00000100:00100000:0.0:1787834209.191631:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406253568 00000100:00100000:0.0:1787834209.191664:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787834209.191672:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6359dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874679406253568:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787834209.191693:0:22704:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:0.0:1787834209.191767:0:22704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x996d2fb20dc1efb8 00000004:00100000:0.0:1787834209.191783:0:22704:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787834209.191820:0:22704:0:(import.c:65:import_set_state_nolock()) ffff8df504eab000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787834209.191867:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6359dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874679406253568:12345-0@lo:38:llog_process_th.0 Request processed in 194us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834209.191875:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787834209.191912:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df636ad4b40 x1874679406253568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834209.191921:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787834209.191929:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787834209.191936:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787834209.191939:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787834209.191942:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df502d4b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787834209.191947:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874679406253568:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1787834209.194771:0:25039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787834209.194788:0:25039:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8df635428000) 00000020:00000080:0.0:1787834209.194812:0:25039:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787834209.194907:0:25039:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8df503fe1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787834209.194911:0:25039:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8df503fe1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787834209.194914:0:25039:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8df503fe1800 3 00010000:00080000:0.0:1787834209.194944:0:25039:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8df6359bd000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.117@tcp at head 00010000:00010000:0.0:1787834209.196599:0:25039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787834209.199116:0:25039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787834209.199166:0:25039:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787834209.199191:0:25039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x996d2fb20dc1efc6 00000100:00080000:2.0:1787834209.199202:0:25039:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787834209.199208:0:25039:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8df6359bd000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1787834209.199240:0:25039:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df502509a40 x1874679406253696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787834209.199267:0:25039:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787834209.209881:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406253696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787834209.209954:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.210122:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406253696 00000100:00100000:0.0:1787834209.210129:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406253696 00000100:00100000:0.0:1787834209.210162:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787834209.210168:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874679406253696:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787834209.210216:0:22706:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:0.0:1787834209.210246:0:22706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x996d2fb20dc1efcd 00000004:00100000:0.0:1787834209.210259:0:22706:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787834209.210287:0:22706:0:(import.c:65:import_set_state_nolock()) ffff8df60ed4a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787834209.210329:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874679406253696:12345-0@lo:38:llog_process_th.0 Request processed in 160us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834209.210336:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787834209.210371:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df502509a40 x1874679406253696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787834219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834209.210380:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787834209.210387:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787834209.210392:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787834209.210401:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787834209.210404:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df6359bd000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787834209.210409:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874679406253696:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787834209.211922:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00080000:3.0:1787834209.212394:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834209.212399:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834209.212408:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834209.212412:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787834209.212434:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406253824:0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.212505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.212557:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406253824 00000100:00100000:3.0:1787834209.212563:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406253824 00000100:00100000:3.0:1787834209.212603:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787834209.212610:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406253824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.212658:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406253824:12345-0@lo:400:kworker.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.212665:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787834209.212701:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406253824:0@lo:400:kworker.0 00000020:01000000:3.0:1787834209.212724:0:25025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787834209.212797:0:25025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787834209.212817:0:25025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b200/0x996d2fb20dc1ef9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1efa3 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.212827:0:25025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3b200/0x996d2fb20dc1ef9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1efa3 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787834209.212878:0:25025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787834209.212880:0:25025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834209.212881:0:25025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834209.212882:0:25025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834209.212884:0:25025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834209.212885:0:25025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834209.212887:0:25025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834209.212889:0:25025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834209.212890:0:25025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787834209.212901:0:25025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787834209.212903:0:25025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787834209.212904:0:25025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787834209.212905:0:25025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787834209.212905:0:25025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787834209.212906:0:25025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787834209.212907:0:25025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787834209.212908:0:25025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787834209.212909:0:25025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787834209.212909:0:25025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787834209.212924:0:25025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787834209.212936:0:25025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787834209.212970:0:25025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.212994:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406253952 00000100:00100000:3.0:1787834209.212997:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406253952 00000100:00100000:3.0:1787834209.213021:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787834209.213028:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253952:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787834209.213047:0:22700:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787834209.213059:0:22700:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787834209.213294:0:25025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602d8fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787834209.213332:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406254080:0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.213362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.213397:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406254080 00000100:00100000:3.0:1787834209.213401:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406254080 00000100:00100000:3.0:1787834209.213427:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787834209.213434:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e122d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406254080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.213472:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e122d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406254080:12345-0@lo:400:kworker.0 Request processed in 38us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.213477:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787834209.213506:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df60e120f00 x1874679406254080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834209.213528:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406254080:0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.213561:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406254208:0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.213591:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.213618:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406254208 00000100:00100000:3.0:1787834209.213622:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406254208 00000100:00100000:3.0:1787834209.213640:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787834209.213646:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e1221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406254208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.213678:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e1221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406254208:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.213685:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787834209.213711:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406254208:0@lo:400:kworker.0 00000100:00080000:3.0:1787834209.217571:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834209.217578:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787834209.217582:0:8:0:(import.c:65:import_set_state_nolock()) ffff8df620707000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787834209.217590:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 681 00000100:00080000:3.0:1787834209.217595:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787834209.217603:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df620707000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1787834209.217641:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406254336:0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.217712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.222117:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406254336 00000100:00100000:3.0:1787834209.222131:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406254336 00000100:00100000:3.0:1787834209.222210:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787834209.222220:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1874679406254336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.222316:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1874679406254336:12345-0@lo:400:kworker.0 Request processed in 98us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.222330:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787834209.222423:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787834209.222451:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df60e120f00 x1874679406254336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787834225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834209.222467:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406254336:0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.222509:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df635a99680 x1874679406254464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787834209.222549:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406254592:0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.222584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.222630:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406254720:0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.222659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.222701:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406254848:0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.222739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834209.222787:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406254592 00000100:00100000:3.0:1787834209.222791:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406254592 00000100:00100000:3.0:1787834209.222814:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406254720 00000100:00100000:3.0:1787834209.222816:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406254720 00000100:00100000:3.0:1787834209.222831:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406254848 00000100:00100000:3.0:1787834209.222833:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406254848 00000100:00100000:3.0:1787834209.222845:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787834209.222851:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406254592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.222885:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874679406254592:12345-0@lo:400:kworker.0 Request processed in 35us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.222891:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787834209.222903:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787834209.222914:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406254720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.222943:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406254720:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.222948:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787834209.222959:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787834209.222964:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406254848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834209.222989:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874679406254848:12345-0@lo:400:kworker.0 Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834209.222995:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787834209.223009:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787834209.223012:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787834209.223026:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a9a940 x1874679406254592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834209.223035:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874679406254592:0@lo:400:kworker.0 00010000:00080000:3.0:1787834209.223054:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a99a40 x1874679406254720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834209.223062:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406254720:0@lo:400:kworker.0 00010000:00080000:3.0:1787834209.223077:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8df635a98000 x1874679406254848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834209.223085:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874679406254848:0@lo:400:kworker.0 00000100:00080000:3.0:1787834209.223103:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834209.223108:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787834209.223111:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787834209.223119:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787834209.223572:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406254464:0@lo:8:kworker.0 00000100:00100000:0.0:1787834209.223608:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834209.223692:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406254464 00000100:00100000:0.0:1787834209.223698:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406254464 00000100:00100000:0.0:1787834209.223722:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834209.223727:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874679406254464:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787834209.223816:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874679406254464:12345-0@lo:8:kworker.0 Request processed in 87us (207us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787834209.223823:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834209.223852:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787834209.223858:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df620707000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787834209.223862:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787834209.223865:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406254464:0@lo:8:kworker.0 20000000:01000000:2.0:1787834209.244191:0:22700:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787834209.244210:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787834209.244466:0:22720:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787834209.244473:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787834209.244498:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.244518:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef41 expref: 24 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.244524:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef4f expref: 24 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.244532:0:22720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.244572:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ef4f expref: 24 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.244587:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef4f expref: 24 pid: 22699 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834209.244615:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406254976:0@lo:104: 00000100:00100000:1.0:1787834209.244684:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834209.245284:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ef41 expref: 24 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.245294:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef41 expref: 24 pid: 22698 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834209.245302:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406255104:0@lo:104: 00000100:00100000:1.0:1787834209.245329:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834209.245354:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60165f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787834209.245403:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406254976 00000100:00100000:2.0:1787834209.245409:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406254976 00000100:00100000:2.0:1787834209.245443:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406255104 00000100:00100000:2.0:1787834209.245445:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406255104 00000100:00100000:2.0:1787834209.245457:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834209.245464:0:22689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+4:22720:x1874679406254976:12345-0@lo:104: 00010000:00010000:2.0:1787834209.245475:0:22689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.245536:0:22689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787834209.245542:0:22689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+4:22720:x1874679406254976:12345-0@lo:104: Request processed in 78us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834209.245548:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834209.245564:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834209.245569:0:22689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406255104:12345-0@lo:104: 00010000:00010000:2.0:1787834209.245583:0:22689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.245614:0:22689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787834209.245619:0:22689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+3:22720:x1874679406255104:12345-0@lo:104: Request processed in 51us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834209.245624:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787834209.245638:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834209.245644:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.245650:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:2.0:1787834209.245654:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.245661:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787834209.245669:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834209.245675:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787834209.245704:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.245710:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787834209.246304:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:25025:x1874679406253952:12345-0@lo:253:mount.lustre.0 Request processed in 33272us (33329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834209.246314:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787834209.246946:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406254976:0@lo:104: 00000100:00100000:1.0:1787834209.246958:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1874679406255104:0@lo:104: 00010000:00010000:1.0:1787834209.246979:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.247071:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834209.247079:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.247086:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3be00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787834209.247090:0:22694:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.247098:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787834209.247104:0:22694:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834209.247109:0:22694:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787834209.247149:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.247155:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787834209.247272:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.247280:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504677c00/0x996d2fb20dc1ef4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ef56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.247305:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834209.247307:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834209.247309:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834209.247323:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406255232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834209.247364:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834209.247408:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787834209.247415:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406255360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834209.247435:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834209.247466:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406255232 00000100:00100000:2.0:1787834209.247471:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406255232 00010000:00010000:2.0:1787834209.247496:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef4f expref: 24 pid: 22699 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834209.247516:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406255360 00000100:00100000:2.0:1787834209.247519:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406255360 00010000:00010000:2.0:1787834209.247529:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef41 expref: 25 pid: 22698 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834209.247545:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834209.247552:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+25:3638:x1874679406255232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834209.247563:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834209.247567:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef4f expref: 25 pid: 22699 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.247579:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef4f expref: 25 pid: 22699 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.247594:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4fc00/0x996d2fb20dc1ef56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ef4f expref: 25 pid: 22699 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.247612:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834209.247643:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3638:x1874679406255232:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834209.247650:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834209.247664:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834209.247670:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+23:3638:x1874679406255360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787834209.247678:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834209.247683:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef41 expref: 23 pid: 22698 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.247692:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef41 expref: 23 pid: 22698 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.247701:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df611a4f600/0x996d2fb20dc1ef48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ef41 expref: 23 pid: 22698 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.247710:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.247718:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834209.249046:0:25025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e123840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9903e54-1448-45ce-bd63-f50f2c84e331:25025:1874679406253952:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787834209.249062:0:25025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787834209.249065:0:25025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787834209.249067:0:25025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787834209.249068:0:25025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787834209.249070:0:25025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787834209.249071:0:25025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787834209.249083:0:25025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787834209.249084:0:25025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787834209.249086:0:25025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787834209.249087:0:25025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787834209.249102:0:25025:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787834209.249949:0:22690:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018224175s 00010000:00010000:2.0:1787834209.249959:0:22690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.249969:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.249987:0:22690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.249994:0:22690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.250000:0:22690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834209.250004:0:22690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.250011:0:22690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.250041:0:22690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834209.250052:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834209.250110:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+22:3638:x1874679406255360:12345-0@lo:103:ldlm_bl.0 Request processed in 2439us (2672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834209.250120:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834209.250164:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406255360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787834209.250174:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406255232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787834209.250240:0:22720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.250248:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834209.250253:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3b000/0x996d2fb20dc1efd4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787834209.252982:0:25025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:3.0:1787834209.254323:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.254339:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df503c3be00/0x996d2fb20dc1ef41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ef48 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834209.254360:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834209.254362:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834209.254365:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787834209.258865:0:25025:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787834209.258876:0:25025:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787834209.258913:0:25025:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787834209.258959:0:25025:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787834209.258979:0:25025:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787834209.259009:0:25025:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787834209.280478:0:25025:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787834209.280718:0:25025:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787834209.431416:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834210.007645:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1787834210.166530:0:25093:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787834210.166776:0:25093:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787834210.453915:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787834210.773856:0:22703:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787834210.773863:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df503c53800 from 14 10000000:01000000:1.0:1787834210.773868:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787834210.773911:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1efdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.773923:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1efdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.773936:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1efdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834210.773961:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406255488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787834210.774028:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834210.774076:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df610a3b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787834210.774203:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406255488 00000100:00100000:0.0:1787834210.774210:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406255488 00000100:00100000:0.0:1787834210.774813:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787834210.774824:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+22:22703:x1874679406255488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834210.774839:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834210.774852:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df504677c00/0x996d2fb20dc1efe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1efdb expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834210.774875:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df504677c00/0x996d2fb20dc1efe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1efdb expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834210.774886:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df504677c00/0x996d2fb20dc1efe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1efdb expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834210.774896:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df504677c00, rc 0) 00000100:00100000:0.0:1787834210.774941:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406255488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834210.774947:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787834210.775031:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406255488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834210.775045:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1efdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1efe2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.775054:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1efdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1efe2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834210.775108:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406255616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787834210.775140:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834210.776206:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df610a3b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787834210.776337:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406255616 00000100:00100000:2.0:1787834210.776347:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406255616 00000100:00100000:3.0:1787834210.776658:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787834210.776671:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406255616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787834210.776694:0:22700:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787834210.776715:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787834210.776718:0:22700:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1787834210.776947:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406255616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 280us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834210.776955:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787834210.777597:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406255616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787834210.777664:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787834210.777674:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1efdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1efe2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.777691:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3a800/0x996d2fb20dc1efdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1efe2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787834210.778125:0:22703:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787834210.778128:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8df60ed4e000 from 14 10000000:01000000:1.0:1787834210.778131:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787834210.778160:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1efe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.783700:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1efe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.783727:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1efe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834210.783771:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406255744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787834210.783842:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834210.783878:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df610a3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787834210.783903:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406255744 00000100:00100000:1.0:1787834210.783909:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406255744 00000100:00100000:1.0:1787834210.783956:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787834210.783967:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406255744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834210.783981:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834210.783998:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df503c3be00/0x996d2fb20dc1eff0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1efe9 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.784024:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df503c3be00/0x996d2fb20dc1eff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1efe9 expref: 24 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.784240:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df503c3be00/0x996d2fb20dc1eff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1efe9 expref: 24 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.784250:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df503c3be00, rc 0) 00000100:00100000:1.0:1787834210.784291:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:22703:x1874679406255744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 327us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834210.784298:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787834210.784351:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406255744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834210.784366:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1efe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eff0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.784375:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1efe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1eff0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834210.784451:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406255872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787834210.784488:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834210.784506:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df610a3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787834210.784740:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406255872 00000100:00100000:1.0:1787834210.784745:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406255872 00000100:00100000:1.0:1787834210.784812:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787834210.784820:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+24:22703:x1874679406255872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787834210.784837:0:22698:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787834210.784853:0:22698:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787834210.784857:0:22698:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787834210.784956:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+24:22703:x1874679406255872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834210.784972:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787834210.785012:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406255872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787834210.785216:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787834210.785226:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1efe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eff0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834210.785234:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df503c3b000/0x996d2fb20dc1efe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1eff0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834211.158882:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406256000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834211.158959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834211.159013:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406256000 00000100:00100000:0.0:1787834211.159034:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406256000 00000100:00100000:0.0:1787834211.159078:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787834211.159087:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406256000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787834211.159119:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834211.159161:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406256000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834211.159180:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787834211.159226:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406256000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834211.159391:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50250bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1874679406256256:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787834211.159421:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.159446:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787834211.159459:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406256256 00000100:00100000:2.0:1787834211.159462:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406256256 00000100:00100000:2.0:1787834211.159502:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787834211.159510:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23446:x1874679406256256:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787834211.159537:0:24210:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00080000:2.0:1787834211.159674:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787834211.159972:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406256384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787834211.160007:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834211.160056:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406256384 00000100:00100000:1.0:1787834211.160059:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406256384 00000100:00100000:1.0:1787834211.160086:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787834211.160092:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406256384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787834211.160109:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787834211.160145:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406256384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834211.160151:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787834211.160196:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406256384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834211.160669:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406256128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787834211.160698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.160808:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406256128 00000100:00100000:2.0:1787834211.160813:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406256128 00000100:00100000:2.0:1787834211.160844:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787834211.160850:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1874679406256128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787834211.160864:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834211.160896:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1874679406256128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.160902:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787834211.161061:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df502508f00 x1874679406256128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834211.161076:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502508f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406256128:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1787834211.162229:0:24205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787834211.201744:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23446:x1874679406256256:12345-0@lo:5:osp-pre-0-1.0 Request processed in 42227us (42314us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787834211.201779:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787834211.202183:0:23446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50250bc00 x1874679406256256/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787834227 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834211.202201:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50250bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1874679406256256:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787834211.202215:0:23446:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1787834211.202259:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23446:1874679406256512:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787834211.202295:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834211.202324:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df610b370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834211.202395:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406256512 00000100:00100000:2.0:1787834211.202401:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406256512 00000100:00100000:2.0:1787834211.202443:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787834211.202452:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23446:x1874679406256512:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787834211.202514:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23446:x1874679406256512:12345-0@lo:900:osp-pre-0-1.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.202521:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787834211.202602:0:23446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df63fcb3480 x1874679406256512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787834227 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834211.202612:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23446:1874679406256512:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787834211.285871:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834191/real 1787834191] req@ffff8df50568ed00 x1874679406242304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.285902:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df50568ed00 x1874679406242304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.285913:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787834191/real 1787834191] req@ffff8df50568fc00 x1874679406242432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834211 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.285939:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8df50568fc00 x1874679406242432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787834211 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787834211.285959:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df504686000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834211.285981:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787834211.285985:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406242304:0@lo:8:kworker.0 00000100:00080000:2.0:1787834211.285991:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df620728000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787834211.285997:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787834211.286000:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406242432:0@lo:8:kworker.0 00000100:00080000:1.0:1787834211.286412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834211.286417:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787834211.286420:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df504686000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787834211.286425:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 667 00000100:00080000:1.0:1787834211.286430:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787834211.286442:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8df504686000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834211.286462:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df636ad61c0 x1874679406256768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834211.286475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834211.286478:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787834211.286480:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df620728000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787834211.286483:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 667 00000100:00080000:1.0:1787834211.286486:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787834211.286489:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8df620728000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834211.286500:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df636ad70c0 x1874679406256896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787834211.286526:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787834211.286529:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787834211.286531:0:36:0:(import.c:65:import_set_state_nolock()) ffff8df620707000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787834211.286536:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8df620707000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1787834211.286548:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8df636ad4b40 x1874679406257152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787834211.286628:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df620950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406257408:0@lo:400:kworker.0 00000100:00100000:1.0:1787834211.286692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834211.286723:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787834211.286739:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406256640:0@lo:400:kworker.0 00000100:00100000:1.0:1787834211.286788:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834211.286813:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406257536:0@lo:400:kworker.0 00000100:00100000:1.0:1787834211.286837:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834211.286869:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406257024:0@lo:400:kworker.0 00000100:00100000:1.0:1787834211.286892:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834211.286909:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406257664:0@lo:400:kworker.0 00000100:00100000:1.0:1787834211.286932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834211.286951:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787834211.286957:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406257280:0@lo:400:kworker.0 00000100:00100000:1.0:1787834211.286977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.287084:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406256768:0@lo:8:kworker.0 00000100:00100000:2.0:1787834211.287117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.287141:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406256896:0@lo:8:kworker.0 00000100:00100000:2.0:1787834211.287176:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.287193:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406257152:0@lo:8:kworker.0 00000100:00100000:2.0:1787834211.287215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.287244:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406256768 00000100:00100000:2.0:1787834211.287251:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406256768 00000100:00100000:2.0:1787834211.287278:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406256896 00000100:00100000:2.0:1787834211.287281:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406256896 00000100:00100000:2.0:1787834211.287289:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406257152 00000100:00100000:2.0:1787834211.287291:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406257152 00000100:00100000:2.0:1787834211.287302:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787834211.287309:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406256768:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787834211.287337:0:24209:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:2.0:1787834211.287366:0:24209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1eff7 00002000:00100000:2.0:1787834211.287384:0:24209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8df504d01000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787834211.287387:0:24209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787834211.287390:0:24209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787834211.287450:0:24209:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787834211.287471:0:24209:0:(import.c:65:import_set_state_nolock()) ffff8df504d04000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834211.287516:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502508f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874679406256768:12345-0@lo:8:kworker.0 Request processed in 207us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.287523:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787834211.287540:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834211.287543:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406256896:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787834211.287557:0:24209:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:2.0:1787834211.287572:0:24209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x996d2fb20dc1effe 00002000:00100000:2.0:1787834211.287578:0:24209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8df504d05800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787834211.287581:0:24209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787834211.287583:0:24209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787834211.287732:0:24209:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787834211.287744:0:24209:0:(import.c:65:import_set_state_nolock()) ffff8df504d00000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834211.287793:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874679406256896:12345-0@lo:8:kworker.0 Request processed in 248us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.287800:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787834211.287812:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834211.287817:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1874679406257152:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787834211.287832:0:24209:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:2.0:1787834211.287848:0:24209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x996d2fb20dc1f005 00002000:00100000:2.0:1787834211.287853:0:24209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8df504d06800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787834211.287863:0:24209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787834211.287864:0:24209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787834211.287891:0:24209:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787834211.287905:0:24209:0:(import.c:65:import_set_state_nolock()) ffff8df503bc6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834211.287933:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874679406257152:12345-0@lo:8:kworker.0 Request processed in 114us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.287938:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787834211.287976:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df636ad61c0 x1874679406256768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787834236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.287985:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787834211.287991:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787834211.287997:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787834211.288001:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787834211.288003:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df504686000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787834211.288016:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787834211.288020:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406256768:0@lo:8:kworker.0 00010000:00080000:2.0:1787834211.288033:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df636ad70c0 x1874679406256896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787834236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.288040:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787834211.288044:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787834211.288049:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787834211.288051:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787834211.288053:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df620728000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787834211.288064:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787834211.288067:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874679406256896:0@lo:8:kworker.0 00010000:00080000:2.0:1787834211.288079:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df636ad4b40 x1874679406257152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787834236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787834211.288093:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787834211.288097:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787834211.288100:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787834211.288102:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8df620707000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787834211.288113:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787834211.288117:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874679406257152:0@lo:8:kworker.0 00000004:00080000:2.0:1787834211.288188:0:22731:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787834211.288205:0:22731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22731:1874679406257920:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787834211.288229:0:22731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.288243:0:22731:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6480 going to sleep for 11 seconds 00000004:00080000:2.0:1787834211.288256:0:22730:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787834211.288312:0:22730:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687201560442ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787834211.288318:0:22730:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787834211.288356:0:23448:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787834211.288370:0:23448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df50568fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1874679406258176:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787834211.288401:0:23448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.288415:0:23448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787834211.288427:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406257792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787834211.288449:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.288483:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406258048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787834211.288505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.288535:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406257792 00000100:00100000:2.0:1787834211.288539:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406257792 00000100:00100000:2.0:1787834211.288569:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406258048 00000100:00100000:2.0:1787834211.288572:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406258048 00000100:00100000:2.0:1787834211.288592:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787834211.288598:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406257792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787834211.288617:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787834211.288652:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406257792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.288659:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787834211.288671:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787834211.288677:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874679406258048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787834211.288686:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787834211.288713:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504776d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874679406258048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.288719:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787834211.288737:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787834211.288745:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406257920 00000100:00100000:2.0:1787834211.288748:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406257920 00000100:00100000:2.0:1787834211.288790:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406258176 00000100:00100000:2.0:1787834211.288792:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406258176 00000100:00100000:2.0:1787834211.288802:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787834211.288808:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22731:x1874679406257920:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:2.0:1787834211.289000:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df636ad61c0 x1874679406258048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.289014:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406258048:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787834211.289038:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5025092c0 x1874679406257792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.289053:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5025092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406257792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787834211.289072:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787834211.289085:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23448:x1874679406258176:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787834211.291444:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406256640 00000100:00100000:0.0:1787834211.291467:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406256640 00000100:00100000:0.0:1787834211.291515:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787834211.291522:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3638:x1874679406256640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834211.291589:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3638:x1874679406256640:12345-0@lo:400:kworker.0 Request processed in 68us (4801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834211.291595:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787834211.295357:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406257408 00000100:00100000:3.0:1787834211.295369:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406257408 00000100:00100000:3.0:1787834211.295432:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406257536 00000100:00100000:3.0:1787834211.295435:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406257536 00000100:00100000:3.0:1787834211.295452:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406257024 00000100:00100000:3.0:1787834211.295455:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406257024 00000100:00100000:3.0:1787834211.295465:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406257664 00000100:00100000:3.0:1787834211.295468:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406257664 00000100:00100000:3.0:1787834211.295480:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406257280 00000100:00100000:3.0:1787834211.295483:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406257280 00000100:00100000:3.0:1787834211.295498:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787834211.295506:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406257408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834211.295591:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406257408:12345-0@lo:400:kworker.0 Request processed in 86us (8898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834211.295608:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787834211.295626:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787834211.295631:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406257536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834211.295660:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406257536:12345-0@lo:400:kworker.0 Request processed in 29us (8822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834211.295666:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787834211.295677:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787834211.295682:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406257024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834211.295715:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406257024:12345-0@lo:400:kworker.0 Request processed in 33us (8823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834211.295721:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787834211.295732:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787834211.295737:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406257664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834211.295781:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406257664:12345-0@lo:400:kworker.0 Request processed in 44us (8848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834211.295787:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787834211.295798:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787834211.295804:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406257280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834211.295829:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406257280:12345-0@lo:400:kworker.0 Request processed in 26us (8852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834211.295835:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:3.0:1787834211.295894:0:22729:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787834211.295916:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22729:1874679406258432:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787834211.295955:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834211.295982:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df602d8f900 going to sleep for 11 seconds 00000004:00080000:3.0:1787834211.295999:0:22728:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787834211.296308:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406256640:0@lo:400:kworker.0 00010000:00080000:2.0:1787834211.296330:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6329a92c0 x1874679406257536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.296342:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406257536:0@lo:400:kworker.0 00010000:00080000:2.0:1787834211.296354:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df620950000 x1874679406257408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.296362:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df620950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406257408:0@lo:400:kworker.0 00000100:00100000:2.0:1787834211.296382:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787834211.296387:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406258304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787834211.296414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.296443:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406258304 00000100:00100000:2.0:1787834211.296447:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406258304 00000100:00100000:2.0:1787834211.296482:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787834211.296488:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504775e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874679406258304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787834211.296517:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834211.296552:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504775e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874679406258304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.296559:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787834211.296588:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df635a9a940 x1874679406258304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787834227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.296603:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406258304:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787834211.297261:0:22728:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687210508808ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787834211.297270:0:22728:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787834211.297288:0:23447:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787834211.297331:0:23447:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 687210579863ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787834211.297335:0:23447:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:1.0:1787834211.299202:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df636ad5680 x1874679406257280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834211.299220:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406257280:0@lo:400:kworker.0 00010000:00080000:1.0:1787834211.299236:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df636ad6d00 x1874679406257024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834211.299245:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406257024:0@lo:400:kworker.0 00010000:00080000:1.0:1787834211.299258:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6329aa580 x1874679406257664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787834211.299266:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406257664:0@lo:400:kworker.0 00000100:00080000:1.0:1787834211.299298:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787834211.299304:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787834211.299307:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787834211.301127:0:23436:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787834211.301316:0:24845:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787834211.301326:0:24845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:3.0:1787834211.302821:0:22685:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787834211.302840:0:22685:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787834211.303907:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406258432 00000100:00100000:1.0:1787834211.303918:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406258432 00000100:00100000:1.0:1787834211.304100:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787834211.304111:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22729:x1874679406258432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787834211.305913:0:24208:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787834211.305925:0:24208:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1787834211.305937:0:24208:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:1.0:1787834211.324514:0:25150:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787834211.324531:0:25150:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1787834211.324535:0:25150:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:1.0:1787834211.324869:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.324877:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.324891:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.324895:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.324902:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.324919:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.324929:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.324937:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.324956:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787834211.325493:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.325499:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.325509:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.325512:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.325516:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.325531:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.325540:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.325546:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.325560:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787834211.325858:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834211.325865:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325873:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3bc00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.325877:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325885:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325904:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325912:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f00c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325930:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.325939:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325946:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.325948:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325956:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325966:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325973:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062f92229/0x996d2fb20dc1f013 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.325986:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.325987:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.325989:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.325995:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834211.326933:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.326942:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.326953:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.326957:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.326962:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.326971:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.326980:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.326999:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.327027:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787834211.330960:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.330974:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.330991:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.330995:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.331002:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.331015:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.331026:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.331034:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.331058:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787834211.331538:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.331544:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.331557:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.331560:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.331564:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.331573:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.331582:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.331589:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.331603:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787834211.332000:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.332006:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332025:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.332028:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.332032:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332041:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332059:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332065:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332073:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787834211.332368:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.332374:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332382:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.332385:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.332389:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332398:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332406:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332413:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332432:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787834211.332693:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.332699:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332708:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.332711:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.332714:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332722:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332740:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332765:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.332776:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787834211.333879:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.333888:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.333897:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.333907:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.333912:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.333920:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.333928:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.333935:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.333944:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1787834211.334286:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787834211.334294:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334302:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3aa00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.334306:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334326:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334343:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334351:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fd7b564/0x996d2fb20dc1f01a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334371:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787834211.334375:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334381:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.334384:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334391:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334400:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334408:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000951ce645/0x996d2fb20dc1f021 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334432:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787834211.334435:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334441:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.334444:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334452:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334461:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334469:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072cafb24/0x996d2fb20dc1f028 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334479:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787834211.334483:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334488:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.334491:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334508:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334517:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334523:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f02f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334535:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787834211.334539:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334545:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.334548:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334555:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334564:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334571:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4f908a/0x996d2fb20dc1f036 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334597:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834211.334600:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334605:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.334608:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334615:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334625:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334632:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20c161d/0x996d2fb20dc1f03d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334644:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.334647:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334652:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.334655:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334673:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334683:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334690:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066c302ca/0x996d2fb20dc1f044 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.334703:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.334705:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.334706:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.334713:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834211.334869:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.334875:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.334883:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.334886:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.334890:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.334899:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.334906:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.334919:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.334938:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787834211.335258:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.335264:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335272:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.335275:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.335279:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335287:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335294:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335300:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335313:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787834211.335584:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.335590:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335604:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.335606:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.335610:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335619:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335627:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335633:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335641:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787834211.335941:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.335948:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335957:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.335960:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.335964:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335972:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335988:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.335994:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.336002:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787834211.337416:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787834211.337425:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337436:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.337441:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337450:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337467:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337481:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001479d797/0x996d2fb20dc1f04b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337499:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787834211.337503:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337509:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.337512:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337520:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337531:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337537:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d2c2b85/0x996d2fb20dc1f052 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337549:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834211.337553:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337558:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.337566:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337574:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337584:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337591:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000906f8161/0x996d2fb20dc1f059 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337604:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.337607:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337613:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.337615:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337622:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337631:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337638:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f060 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.337656:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.337658:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.337660:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.337666:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.344077:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787834211.348530:0:24209:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787834211.348537:0:24209:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787834211.348617:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23448:x1874679406258176:12345-0@lo:7:osp-pre-1-1.0 Request processed in 59530us (60211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834211.348627:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787834211.348726:0:23448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df50568fc00 x1874679406258176/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787834227 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.348768:0:23448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df50568fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1874679406258176:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787834211.348781:0:23448:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787834211.348815:0:23448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1874679406258560:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787834211.348844:0:23448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.348865:0:23448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787834211.348879:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406258560 00000100:00100000:2.0:1787834211.348884:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406258560 00000100:00100000:2.0:1787834211.348915:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787834211.348922:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504776940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23448:x1874679406258560:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787834211.348943:0:24845:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787834211.348968:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504776940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23448:x1874679406258560:12345-0@lo:5:osp-pre-1-1.0 Request processed in 47us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.348974:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787834211.348996:0:23448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5047761c0 x1874679406258560/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787834227 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.349005:0:23448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1874679406258560:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787834211.349023:0:23448:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787834211.349043:0:23448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1874679406258688:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787834211.349061:0:23448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.349072:0:23448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787834211.349081:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406258688 00000100:00100000:2.0:1787834211.349084:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406258688 00000100:00100000:2.0:1787834211.349107:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787834211.349112:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504774780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23448:x1874679406258688:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787834211.349132:0:24209:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:3.0:1787834211.349454:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.349462:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349476:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.349480:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.349487:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349502:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349511:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349519:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349539:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787834211.349874:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.349880:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349888:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.349891:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.349896:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349905:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349913:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349920:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349931:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787834211.349938:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834211.349944:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349950:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.349960:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349969:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349983:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.349991:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eec9c1bd/0x996d2fb20dc1f067 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350005:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.350008:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350025:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.350028:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350036:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350044:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350051:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008131d7c2/0x996d2fb20dc1f06e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350066:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.350068:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.350070:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.350338:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.350344:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350351:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.350354:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.350358:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350367:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350373:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350379:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350391:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834211.350398:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.350402:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350418:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.350421:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350429:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350440:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350447:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000195010c9/0x996d2fb20dc1f075 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.350471:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.350472:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.350474:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.350819:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834211.351602:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834211.351609:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.351618:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=687s v=(0 0) 00010000:00010000:2.0:1787834211.351621:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834211.351626:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.351637:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.351645:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.351650:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.351664:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834211.351987:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.351993:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.352002:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.352006:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.352024:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.352042:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.352050:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075e20517/0x996d2fb20dc1f07c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.352064:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.352066:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.352068:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.353144:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.353152:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.353161:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.353176:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.353181:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.353191:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.353199:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.353205:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.353232:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787834211.353492:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834211.353499:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.353517:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.353520:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.353528:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.353540:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.353547:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f083 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.353572:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.353574:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.353575:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834211.354287:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834211.354294:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.354304:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=687s v=(0 0) 00010000:00010000:2.0:1787834211.354308:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834211.354312:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.354321:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.354336:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.354343:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.354365:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834211.354530:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.354537:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.354545:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.354549:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.354556:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.354568:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.354575:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069d321a8/0x996d2fb20dc1f08a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.354590:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.354592:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.354593:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787834211.355748:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787834211.355773:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.355786:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=687s v=(0 0) 00010000:00010000:2.0:1787834211.355789:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834211.355793:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.355805:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.355814:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.355821:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.355852:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834211.355861:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834211.355868:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.355876:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4f800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.355879:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.355887:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.355900:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.355907:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000584bcb25/0x996d2fb20dc1f091 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.355922:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.355929:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.355930:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.356367:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.356374:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356383:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.356390:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.356395:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356405:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356412:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356420:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356433:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787834211.356675:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.356681:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356690:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.356692:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.356696:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356705:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356712:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356724:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787834211.356740:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.356747:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356812:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787834211.356821:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834211.356825:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.356833:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.356834:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.356836:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.356838:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.356841:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356846:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.356850:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356858:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.356859:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356867:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ef4cf1/0x996d2fb20dc1f098 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.356867:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.356879:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787834211.356891:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834211.356894:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356909:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.356913:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356920:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356930:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356937:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f0a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356952:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.356955:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356962:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.356965:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356972:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.356975:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.356981:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.356994:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caba4b2b/0x996d2fb20dc1f09f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.357009:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.357011:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.357012:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787834211.357229:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787834211.357234:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.357242:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787834211.357245:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834211.357254:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.357263:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.357269:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.357276:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.357287:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834211.357372:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834211.357377:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.357384:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.357386:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.357395:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.357406:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787834211.357666:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.357672:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.357681:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.357683:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.357687:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.357696:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.357704:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.357711:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.357724:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834211.357983:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.357992:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.357999:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.358002:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358010:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358033:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358040:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ad5a34/0x996d2fb20dc1f0b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358061:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.358063:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.358065:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.358092:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b27f255/0x996d2fb20dc1f0ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.358107:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.358108:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.358110:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.358362:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.358369:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358376:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.358379:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.358382:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358402:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358410:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358417:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358428:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834211.358436:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.358439:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358446:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.358449:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358456:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358466:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358474:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ec31175/0x996d2fb20dc1f0bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358492:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.358494:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.358496:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.358809:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.358815:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358822:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.358825:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.358829:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358838:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358846:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358853:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.358870:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834211.358876:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834211.358881:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.358889:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.358892:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.358900:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.358913:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.358921:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038dfad3c/0x996d2fb20dc1f0c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.358941:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.358943:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.358945:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.359142:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.359148:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359175:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.359178:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.359183:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359192:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359201:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359208:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359221:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834211.359229:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.359232:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359239:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.359243:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359251:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359271:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359278:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1fa5fa/0x996d2fb20dc1f0c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359295:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.359297:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.359299:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.359545:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.359551:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359560:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.359562:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.359567:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359576:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359584:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359591:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.359619:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834211.359623:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834211.359628:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.359636:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.359639:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.359648:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.359659:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.359666:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ee30cb/0x996d2fb20dc1f0d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.359683:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.359684:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.359686:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.360153:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.360158:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360180:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.360183:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.360187:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360196:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360203:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360209:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360222:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834211.360229:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.360233:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360239:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.360248:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360256:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360267:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360273:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f0d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.360290:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.360292:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.360294:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.361301:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.361308:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.361317:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.361320:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.361324:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.361332:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.361340:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.361353:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.361374:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787834211.361900:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834211.361907:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.361915:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.361919:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.361927:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.361941:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.361949:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f0de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.361971:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.361973:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.361974:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.362598:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.363204:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.363212:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.363223:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.363227:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.363232:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.363243:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.363252:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.363260:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.363369:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787834211.364509:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.364519:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.364536:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.364540:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.364545:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.364555:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.364564:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.364572:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364645:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834211.364652:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364661:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.364671:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364680:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364696:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364703:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b62078c/0x996d2fb20dc1f0e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364741:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834211.364745:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364767:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.364771:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364778:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364789:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.364797:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.364804:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.364806:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787834211.365313:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.365320:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.365329:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.365333:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.365337:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.365350:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.365358:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.365365:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.365379:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787834211.366926:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.366933:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.366949:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.366952:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.366957:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.366967:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.366974:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.366981:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.367003:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787834211.367834:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787834211.367842:0:24208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f0ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787834211.368061:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.368067:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.368075:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.368078:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.368083:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.368092:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.368110:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.368117:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.368127:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787834211.368597:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787834211.368605:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368613:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.368618:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368638:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368655:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368663:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc9b4d60/0x996d2fb20dc1f0f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368679:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787834211.368683:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368689:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.368692:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368700:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368710:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368717:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a835c84f/0x996d2fb20dc1f0fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368740:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834211.368743:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368768:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.368772:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368780:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368790:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368797:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020230934/0x996d2fb20dc1f101 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.368808:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.368810:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.368812:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787834211.371330:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.371341:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.371357:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.371361:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.371367:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.371380:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.371390:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.371398:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.371437:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787834211.372063:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.372069:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.372079:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.372083:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.372087:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.372097:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.372106:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.372113:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.372122:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787834211.372265:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787834211.372271:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372280:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504677000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.372290:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372300:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372316:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372323:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed112648/0x996d2fb20dc1f108 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372341:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834211.372345:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372356:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.372359:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372366:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372377:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372383:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9af73f5/0x996d2fb20dc1f10f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.372402:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.372404:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.372406:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.373829:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.373837:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.374133:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.374143:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374157:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.374161:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.374175:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374200:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374210:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374217:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374233:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834211.374376:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834211.374382:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.374390:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.374394:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.374401:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.374415:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.374561:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f99944d/0x996d2fb20dc1f116 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.374590:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.374592:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.374593:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.374688:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.374694:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374701:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.374704:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.374708:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374716:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374723:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374765:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.374778:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787834211.375071:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.375077:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375085:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.375088:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.375092:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375100:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375108:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375114:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375127:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787834211.375412:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.375417:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375431:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.375433:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.375437:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375446:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375454:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375461:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375479:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787834211.375716:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.375722:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375808:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.375812:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.375816:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375826:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375845:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375851:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.375859:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787834211.376109:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.376114:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376122:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.376125:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.376129:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376138:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376146:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376152:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376183:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1787834211.376388:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787834211.376396:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376404:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.376409:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376418:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376432:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376439:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000726380de/0x996d2fb20dc1f11d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376464:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787834211.376467:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376473:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.376476:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376495:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376505:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376512:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058e2c993/0x996d2fb20dc1f124 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376524:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787834211.376527:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376533:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.376536:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376544:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376551:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376558:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093e9b73c/0x996d2fb20dc1f12b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376582:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834211.376586:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376592:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.376595:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376602:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376610:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376617:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf90b5e8/0x996d2fb20dc1f132 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376626:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834211.376628:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376634:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.376638:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376653:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376662:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376669:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072cafb24/0x996d2fb20dc1f139 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.376680:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.376681:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.376683:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.376689:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.376880:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.376886:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376895:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.376898:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.376902:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376911:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376919:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376926:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.376944:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1787834211.377636:0:25026:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1787834211.377672:0:25026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787834211.377679:0:25026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787834211.377842:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834211.377847:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.377856:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3b800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.377860:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.377869:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.377882:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.377895:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000951ce645/0x996d2fb20dc1f140 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.377908:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.377909:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.377911:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.378130:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.378136:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378144:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.378153:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.378158:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378179:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378188:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378195:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378207:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787834211.378431:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.378438:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.378450:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.378453:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.378458:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.378468:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.378476:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.378484:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.378494:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787834211.378717:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.378723:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787834211.378834:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.378840:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378847:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.378850:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.378855:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378864:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378872:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378894:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.378901:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787834211.379096:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.379099:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.379104:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.379114:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.379131:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.379139:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.379147:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1787834211.379376:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504774780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23448:x1874679406258688:12345-0@lo:5:osp-pre-1-1.0 Request processed in 30259us (30309us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787834211.379385:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787834211.379440:0:23448:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1787834211.379448:0:23448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1874679406258688:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787834211.379462:0:23448:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1787834211.379509:0:23448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23448:1874679406258816:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787834211.379551:0:23448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.379574:0:23448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6780 going to sleep for 11 seconds 00010000:00010000:2.0:1787834211.379586:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787834211.379591:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379599:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3aa00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.379603:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379610:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379629:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379636:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fd7b564/0x996d2fb20dc1f14e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379651:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787834211.379655:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379661:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.379664:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379671:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379680:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379686:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000200d9053/0x996d2fb20dc1f147 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379696:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787834211.379699:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379710:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3a200 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.379713:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.379720:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787834211.379849:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.379855:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.379863:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.379866:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.379870:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.379878:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.379885:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.379891:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.379898:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787834211.380180:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.380187:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380194:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.380196:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.380200:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380208:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380215:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380221:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380238:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787834211.380484:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.380489:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380497:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.380500:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.380503:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380510:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380517:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380523:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.380531:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787834211.380832:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.380837:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380839:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787834211.380846:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.380850:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.380853:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.380857:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380864:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.380867:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380868:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.380875:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380877:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.380883:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380889:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.380890:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1787834211.380895:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd8fdbe0/0x996d2fb20dc1f155 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380907:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787834211.380910:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380917:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df503c3bc00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.380920:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380927:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380937:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380949:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc914fc0/0x996d2fb20dc1f163 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380962:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787834211.380965:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380972:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.380975:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380982:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.380993:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381000:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d2e7d86/0x996d2fb20dc1f16a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381011:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787834211.381014:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381021:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247000 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.381030:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381037:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381047:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381054:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001228dc74/0x996d2fb20dc1f171 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381066:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834211.381069:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381070:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381077:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.381078:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f92229/0x996d2fb20dc1f15c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381080:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.381087:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.381091:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.381092:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.381094:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.381096:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.381100:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.381103:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd77341/0x996d2fb20dc1f178 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834211.381113:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406258816 00000100:00100000:2.0:1787834211.381120:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406258816 00010000:00010000:1.0:1787834211.381127:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.381128:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.381130:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834211.381162:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787834211.381182:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23448:x1874679406258816:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787834211.381248:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23448:x1874679406258816:12345-0@lo:900:osp-pre-1-1.0 Request processed in 69us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834211.381255:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787834211.381300:0:23448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df5047761c0 x1874679406258816/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787834227 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787834211.381316:0:23448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23448:1874679406258816:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1787834211.381864:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.381870:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.381880:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.381888:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.381893:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.381902:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.381910:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.381917:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.381935:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787834211.382364:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.382370:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.382378:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.382381:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.382385:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.382395:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.382403:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.382414:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.382430:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787834211.382645:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834211.382652:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382660:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.382664:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382673:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382695:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382703:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cdb88aa/0x996d2fb20dc1f17f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382717:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.382721:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382814:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.382819:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382828:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382839:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382846:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000570696e4/0x996d2fb20dc1f186 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382859:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.382861:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.382867:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.382913:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.382918:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382926:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.382929:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.382934:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382944:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382952:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382959:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.382978:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787834211.382988:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787834211.382993:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.383000:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834211.383003:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.383011:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.383023:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.383030:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d1bc68/0x996d2fb20dc1f18d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834211.383056:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.383058:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834211.383060:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787834211.383159:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.383175:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.383183:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.383186:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.383190:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.383198:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.383205:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.383211:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.383228:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787834211.383471:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834211.383477:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.383486:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246400 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.383489:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.383497:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.383508:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.383516:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f194 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.383529:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.383531:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.383533:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.383864:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787834211.384184:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.384190:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.384205:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.384208:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.384212:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.384222:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.384230:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.384238:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.384255:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834211.384496:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.384502:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384510:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.384514:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384533:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384545:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384553:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4d61bb3/0x996d2fb20dc1f19b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384567:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.384568:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.384570:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.384607:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.384612:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384620:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.384623:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.384627:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384636:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384644:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384657:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.384674:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787834211.384837:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787834211.384842:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.384849:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722e00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834211.384857:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.384865:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.384876:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.384883:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009957b9b/0x996d2fb20dc1f1a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834211.384899:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.384901:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787834211.384903:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787834211.388324:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.388337:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.388351:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.388355:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.388361:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.388374:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.388394:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.388402:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.388425:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787834211.389226:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.389234:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.389244:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246a00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.389249:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.389259:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.389275:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.389283:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c820747a/0x996d2fb20dc1f1a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.389300:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.389302:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.389303:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787834211.389947:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787834211.389961:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.389972:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=687s v=(0 0) 00010000:00010000:3.0:1787834211.389975:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834211.389980:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.389991:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.389999:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.390006:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.390035:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787834211.390087:0:24208:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1787834211.390179:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22731:x1874679406257920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 101368us (101947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834211.390189:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787834211.390380:0:24235:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834211.390386:0:24235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390395:0:24235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723600 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:0.0:1787834211.390398:0:24235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390406:0:24235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390419:0:24235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390426:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c84445ef/0x996d2fb20dc1f1b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390442:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834211.390448:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834211.390450:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787834211.390491:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.390496:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390504:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.390508:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.390512:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390521:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390528:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390534:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.390553:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787834211.390922:0:22731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df636ad4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22731:1874679406257920:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787834211.390938:0:22731:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787834211.390978:0:22731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22731:1874679406258944:0@lo:5:osp-pre-1-0.0 00002000:00010000:0.0:1787834211.391122:0:25150:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787834211.391127:0:25150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.391134:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1787834211.391136:0:25150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834211.391140:0:25150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.391154:0:25150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.391161:0:25150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.391178:0:25150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834211.391189:0:25150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1787834211.391390:0:25150:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1787834211.391433:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22729:x1874679406258432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 87325us (95478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834211.391441:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787834211.391483:0:22731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834211.391512:0:22731:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60efe6480 going to sleep for 11 seconds 00010000:00010000:3.0:1787834211.392109:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834211.392117:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392126:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.392136:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392145:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392160:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392178:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ae69cfd/0x996d2fb20dc1f1b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392193:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834211.392196:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392201:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834211.392204:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392210:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392219:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392225:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fff623d/0x996d2fb20dc1f1be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834211.392242:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.392244:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834211.392245:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834211.392276:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22729:1874679406258432:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787834211.392287:0:22729:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787834211.392316:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a9a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22729:1874679406259072:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787834211.392348:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834211.392366:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df6329be600 going to sleep for 11 seconds 00000100:00100000:3.0:1787834211.392380:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406258944 00000100:00100000:3.0:1787834211.392385:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406258944 00000100:00100000:3.0:1787834211.392419:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406259072 00000100:00100000:3.0:1787834211.392422:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406259072 00000100:00100000:3.0:1787834211.392439:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787834211.392445:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504774f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22731:x1874679406258944:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787834211.392480:0:24845:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1787834211.392598:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787834211.392605:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22729:x1874679406259072:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787834211.392625:0:24209:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:0.0:1787834211.415983:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787834211.424769:0:24205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1787834211.424813:0:24205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787834211.424818:0:24205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000100:00100000:2.0:1787834211.425103:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22729:x1874679406259072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 32494us (32750us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787834211.425115:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787834211.425183:0:22729:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787834211.425191:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a9a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22729:1874679406259072:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787834211.425206:0:22729:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:2.0:1787834211.430219:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504774f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22731:x1874679406258944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 37767us (38730us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787834211.430232:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834211.430412:0:22731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22731:1874679406258944:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787834211.430427:0:22731:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1787834211.478284:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787834212.314549:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787834212.501941:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834213.525951:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834214.550927:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834215.579104:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787834216.115019:0:25383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787834216.278224:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406259328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787834216.278300:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834216.278369:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787834216.278376:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406259200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834216.278401:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834216.278436:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406259200 00000100:00100000:2.0:1787834216.278443:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406259200 00000100:00100000:2.0:1787834216.278486:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787834216.278495:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406259200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787834216.278525:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834216.278566:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406259200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834216.278573:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787834216.278614:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406259200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834216.278725:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406259328 00000100:00100000:0.0:1787834216.278747:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406259328 00000100:00100000:0.0:1787834216.278819:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787834216.278826:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406259328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787834216.278846:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787834216.278881:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406259328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834216.278886:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787834216.279093:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787834216.279121:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1787834216.279148:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406259328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787834216.283161:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406259456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834216.283232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834216.283284:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406259456 00000100:00100000:2.0:1787834216.283291:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406259456 00000100:00100000:2.0:1787834216.283329:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787834216.283337:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406259456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787834216.283375:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787834216.283434:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406259456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834216.283442:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787834216.283528:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504775680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406259456:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787834216.598215:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834216.792379:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406259968:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792483:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406260480:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792532:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787834216.792538:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406259584:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792589:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406260096:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792631:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406260608:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792672:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406259712:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792695:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792726:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406260224:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792786:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406260736:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792833:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787834216.792839:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406259840:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792859:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792875:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406260352:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.792898:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.792923:0:25150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406260096 00000100:00100000:0.0:1787834216.792929:0:25150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406260096 00000100:00100000:0.0:1787834216.792987:0:25150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406259712 00000100:00100000:0.0:1787834216.792991:0:25150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406259712 00000100:00100000:0.0:1787834216.793013:0:25150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406259840 00000100:00100000:0.0:1787834216.793016:0:25150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406259840 00000100:00100000:0.0:1787834216.793032:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787834216.793039:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406260096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.793088:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406260096:12345-0@lo:400:kworker.0 Request processed in 49us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834216.793096:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787834216.793112:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787834216.793119:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406259712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.793162:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406259712:12345-0@lo:400:kworker.0 Request processed in 44us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834216.793168:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787834216.793181:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787834216.793187:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406259840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834216.793541:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406259968 00000100:00100000:3.0:1787834216.793547:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406259968 00000100:00100000:3.0:1787834216.793571:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406260480 00000100:00100000:3.0:1787834216.793573:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406260480 00000100:00100000:3.0:1787834216.793586:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406260608 00000100:00100000:3.0:1787834216.793596:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406260608 00000100:00100000:3.0:1787834216.793610:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406260224 00000100:00100000:3.0:1787834216.793613:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406260224 00000100:00100000:3.0:1787834216.793623:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406260736 00000100:00100000:3.0:1787834216.793625:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406260736 00000100:00100000:3.0:1787834216.793635:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406260352 00000100:00100000:3.0:1787834216.793637:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406260352 00000100:00100000:3.0:1787834216.793649:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787834216.793656:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406259968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834216.793689:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874679406259968:12345-0@lo:400:kworker.0 Request processed in 35us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834216.793695:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787834216.793707:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787834216.793712:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406260480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834216.793734:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406260480:12345-0@lo:400:kworker.0 Request processed in 22us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834216.793739:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787834216.793767:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787834216.793773:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406260608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834216.793797:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874679406260608:12345-0@lo:400:kworker.0 Request processed in 25us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834216.793802:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787834216.793811:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787834216.793816:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406260224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834216.793837:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406260224:12345-0@lo:400:kworker.0 Request processed in 21us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834216.793842:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787834216.793857:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787834216.793862:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406260736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834216.793886:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406260736:12345-0@lo:400:kworker.0 Request processed in 24us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834216.793891:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787834216.793901:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787834216.793906:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406260352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834216.793925:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874679406260352:12345-0@lo:400:kworker.0 Request processed in 20us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834216.793930:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787834216.794278:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1874679406259840:12345-0@lo:400:kworker.0 Request processed in 1090us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834216.794286:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787834216.794322:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787834216.794326:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787834216.794328:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787834216.794331:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787834216.794374:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406259840:0@lo:400:kworker.0 00010000:00080000:0.0:1787834216.794389:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df60eae4b40 x1874679406260352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834216.794399:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874679406260352:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.794408:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406259712:0@lo:400:kworker.0 00010000:00080000:0.0:1787834216.794417:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df60eae5e00 x1874679406260224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834216.794424:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406260224:0@lo:400:kworker.0 00010000:00080000:0.0:1787834216.794432:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df60eae4f00 x1874679406260736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834216.794440:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406260736:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.794477:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406260096:0@lo:400:kworker.0 00010000:00080000:0.0:1787834216.794486:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df60eae43c0 x1874679406260608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834216.794494:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874679406260608:0@lo:400:kworker.0 00010000:00080000:0.0:1787834216.794503:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df60eae7480 x1874679406259968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834216.794509:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874679406259968:0@lo:400:kworker.0 00010000:00080000:0.0:1787834216.794517:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df60eae61c0 x1874679406260480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834216.794535:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406260480:0@lo:400:kworker.0 00000001:00080000:0.0:1787834216.794645:0:25026:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:1.0:1787834216.796353:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406259584 00000100:00100000:1.0:1787834216.796365:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406259584 00000100:00100000:1.0:1787834216.796424:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787834216.796433:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3638:x1874679406259584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834216.796512:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3638:x1874679406259584:12345-0@lo:400:kworker.0 Request processed in 81us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834216.796519:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787834216.796578:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63fcb12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406259584:0@lo:400:kworker.0 00000100:00100000:0.0:1787834216.796886:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406260864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787834216.796927:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.796965:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406260864 00000100:00100000:0.0:1787834216.796970:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406260864 00000100:00100000:0.0:1787834216.797001:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787834216.797007:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406260864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787834216.797029:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787834216.797067:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406260864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834216.797073:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787834216.797109:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406260864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787834216.797977:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406260992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787834216.798029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834216.798473:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406260992 00000100:00100000:0.0:1787834216.798480:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406260992 00000100:00100000:0.0:1787834216.798524:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787834216.798531:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406260992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787834216.798551:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787834216.798594:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406260992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834216.798600:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787834216.800367:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1787834216.800410:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406260992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787834216.807663:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787834216.807707:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406261120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787834216.807797:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834216.810798:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406261120 00000100:00100000:3.0:1787834216.810812:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406261120 00000100:00100000:3.0:1787834216.810884:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787834216.810897:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504777840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406261120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787834216.810926:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787834216.811291:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504777840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406261120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 397us (3492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834216.811299:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787834216.811393:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406261120:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1787834217.292346:0:25436:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787834217.293314:0:25436:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787834217.630050:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787834218.366331:0:25487:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787834218.366549:0:25487:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787834218.646100:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834218.708411:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834218.713224:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382032896 00000100:00100000:1.0:1787834218.713239:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382032896 00000100:00100000:1.0:1787834218.713311:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:1.0:1787834218.713319:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1874679382032896:12345-192.168.203.17@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787834218.713348:0:22698:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 4b8888f5-5649-4fae-a1a1-da83a70d41f3@192.168.203.17@tcp t0 exp 0000000000000000 cur 694 last 0 00000020:00000080:1.0:1787834218.713382:0:22698:0:(genops.c:1385:class_connect()) connect: client 4b8888f5-5649-4fae-a1a1-da83a70d41f3, cookie 0x996d2fb20dc1f1c5 00000100:00080000:1.0:1787834218.713937:0:22698:0:(import.c:65:import_set_state_nolock()) ffff8df502d4c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834218.714156:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+5:2397:x1874679382032896:12345-192.168.203.17@tcp:250:mount.lustre.0 Request processed in 834us (5752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834218.714165:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:2.0:1787834218.735175:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.737210:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382033024 00000100:00100000:0.0:1787834218.737221:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382033024 00000100:00100000:0.0:1787834218.737298:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:0.0:1787834218.737321:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+5:18051:x1874679382033024:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787834218.737337:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834218.737353:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247800/0x996d2fb20dc1f1cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0ee expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834218.737380:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247800/0x996d2fb20dc1f1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0ee expref: 6 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834218.737390:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247800/0x996d2fb20dc1f1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0ee expref: 6 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834218.737398:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247800, rc 0) 00000100:00100000:0.0:1787834218.737454:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+6:18051:x1874679382033024:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 135us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834218.737463:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:0.0:1787834218.739481:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834218.742200:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382033152 00000100:00100000:1.0:1787834218.742214:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382033152 00000100:00100000:1.0:1787834218.742574:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:1.0:1787834218.742586:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+6:18051:x1874679382033152:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787834218.742730:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+6:18051:x1874679382033152:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 146us (3255us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787834218.742739:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:2.0:1787834218.755889:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.756200:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382033280 00000100:00100000:0.0:1787834218.756210:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382033280 00000100:00100000:0.0:1787834218.756266:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:0.0:1787834218.756275:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+6:18051:x1874679382033280:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787834218.756294:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834218.756311:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1f1d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f0f5 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834218.756341:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1f1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0f5 expref: 7 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834218.756357:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b246a00/0x996d2fb20dc1f1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f0f5 expref: 7 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834218.756380:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246a00, rc 0) 00000100:00100000:0.0:1787834218.756447:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+7:18051:x1874679382033280:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 173us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834218.756455:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:2.0:1787834218.766438:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834218.766829:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382033408 00000100:00100000:1.0:1787834218.766838:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382033408 00000100:00100000:1.0:1787834218.766894:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:1.0:1787834218.766904:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+7:18051:x1874679382033408:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787834218.767271:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18051:x1874679382033408:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 367us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834218.767279:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:1.0:1787834218.769432:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834218.769516:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382033536 00000100:00100000:2.0:1787834218.769524:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382033536 00000100:00100000:2.0:1787834218.769572:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:2.0:1787834218.769581:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18051:x1874679382033536:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787834218.769740:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18051:x1874679382033536:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 159us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834218.769776:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:2.0:1787834218.772532:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834218.774900:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382033664 00000100:00100000:1.0:1787834218.774916:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382033664 00000100:00100000:1.0:1787834218.774996:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:1.0:1787834218.775285:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18070:x1874679382033664:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787834218.775443:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18070:x1874679382033664:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 161us (2918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834218.786842:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:3.0:1787834218.824548:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.824650:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382033792 00000100:00100000:0.0:1787834218.824660:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382033792 00000100:00100000:0.0:1787834218.824716:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00100000:0.0:1787834218.824726:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18070:x1874679382033792:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787834218.824910:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18070:x1874679382033792:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 184us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834218.824918:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00100000:3.0:1787834218.827480:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834218.827819:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382033920 00000100:00100000:1.0:1787834218.827828:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382033920 00000100:00100000:1.0:1787834218.827876:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:1.0:1787834218.827884:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18070:x1874679382033920:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787834218.828029:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18070:x1874679382033920:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 145us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834218.828047:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:1.0:1787834218.835179:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834218.844328:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382034048 00000100:00100000:2.0:1787834218.844341:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382034048 00000100:00100000:2.0:1787834218.844424:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:2.0:1787834218.844434:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+8:18051:x1874679382034048:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787834218.844452:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834218.844484:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1f1da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f126 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834218.844515:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1f1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f126 expref: 9 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834218.844526:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4f800/0x996d2fb20dc1f1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f126 expref: 9 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834218.844535:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f800, rc 0) 00000100:00100000:2.0:1787834218.844597:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+9:18051:x1874679382034048:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 163us (9428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834218.845314:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:3.0:1787834218.850857:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.853235:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382034176 00000100:00100000:0.0:1787834218.853257:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382034176 00000100:00100000:0.0:1787834218.853324:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:0.0:1787834218.853336:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+9:18051:x1874679382034176:12345-192.168.203.17@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787834218.853361:0:22700:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787834218.853386:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787834218.853390:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787834218.853392:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787834218.853395:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787834218.853397:0:22700:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1787834218.858954:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+9:18051:x1874679382034176:12345-192.168.203.17@tcp:256:mount.lustre.0 Request processed in 5609us (8094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834218.858969:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:2.0:1787834218.865396:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.866947:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382034304 00000100:00100000:0.0:1787834218.867217:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382034304 00000100:00100000:0.0:1787834218.867461:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:0.0:1787834218.867472:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+9:18051:x1874679382034304:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787834218.867488:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834218.867505:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f12d expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834218.867531:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f12d expref: 10 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834218.867543:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f12d expref: 10 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834218.867552:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247600, rc 0) 00000100:00100000:0.0:1787834218.867603:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18051:x1874679382034304:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 134us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834218.867610:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:0.0:1787834218.878283:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834218.878521:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382034432 00000100:00100000:1.0:1787834218.878532:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382034432 00000100:00100000:1.0:1787834218.878595:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 127 00000100:00100000:1.0:1787834218.878604:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18051:x1874679382034432:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787834218.878789:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18051:x1874679382034432:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 184us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834218.878797:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 127 00000100:00100000:3.0:1787834218.884670:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834218.884781:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382034560 00000100:00100000:1.0:1787834218.884791:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382034560 00000100:00100000:1.0:1787834218.884846:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:1.0:1787834218.884855:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18051:x1874679382034560:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787834218.884993:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18051:x1874679382034560:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 138us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834218.885001:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:3.0:1787834218.891568:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.891657:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382034688 00000100:00100000:0.0:1787834218.891666:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382034688 00000100:00100000:0.0:1787834218.891715:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:0.0:1787834218.891724:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18074:x1874679382034688:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787834218.891896:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18074:x1874679382034688:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 172us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834218.891904:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:3.0:1787834218.912326:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.913291:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382034816 00000100:00100000:0.0:1787834218.913301:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382034816 00000100:00100000:0.0:1787834218.913412:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:0.0:1787834218.913423:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18074:x1874679382034816:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787834218.913571:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18074:x1874679382034816:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 150us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834218.913579:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:3.0:1787834218.922960:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834218.923057:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834218.923090:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382034944 00000100:00100000:3.0:1787834218.923098:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382034944 00000100:00100000:3.0:1787834218.923145:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382035200 00000100:00100000:3.0:1787834218.923148:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382035200 00000100:00100000:3.0:1787834218.923167:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:3.0:1787834218.923174:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1874679382034944:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787834218.923201:0:23763:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 8eda90af-ee5e-43ad-9f5e-133e0c7073b5@192.168.203.17@tcp t0 exp 0000000000000000 cur 694 last 0 00000020:00000080:3.0:1787834218.923249:0:23763:0:(genops.c:1385:class_connect()) connect: client 8eda90af-ee5e-43ad-9f5e-133e0c7073b5, cookie 0x996d2fb20dc1f1e8 00000004:00100000:3.0:1787834218.923271:0:23763:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787834218.923509:0:23763:0:(import.c:65:import_set_state_nolock()) ffff8df62ea21800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834218.923583:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2397:x1874679382034944:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 407us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834218.923591:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:3.0:1787834218.923610:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:3.0:1787834218.923615:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1874679382035200:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787834218.923630:0:23763:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 8eda90af-ee5e-43ad-9f5e-133e0c7073b5@192.168.203.17@tcp t0 exp 0000000000000000 cur 694 last 0 00000020:00000080:3.0:1787834218.923660:0:23763:0:(genops.c:1385:class_connect()) connect: client 8eda90af-ee5e-43ad-9f5e-133e0c7073b5, cookie 0x996d2fb20dc1f1ef 00000004:00100000:3.0:1787834218.923673:0:23763:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787834218.923833:0:23763:0:(import.c:65:import_set_state_nolock()) ffff8df610459000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834218.923858:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2397:x1874679382035200:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 241us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834218.923865:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:3.0:1787834218.947309:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834218.947432:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834218.949382:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.958588:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382035328 00000100:00100000:0.0:1787834218.958602:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382035328 00000100:00100000:0.0:1787834218.958689:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382035072 00000100:00100000:0.0:1787834218.958693:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382035072 00000100:00100000:1.0:1787834218.958714:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:1.0:1787834218.958728:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:0:x1874679382035328:12345-192.168.203.17@tcp:41:mount.lustre.0 00000100:00080000:3.0:1787834218.958745:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1787834218.958781:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1787834218.958789:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787834218.958894:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:0:x1874679382035328:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 169us (11592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834218.965796:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382035456 00000100:00100000:3.0:1787834218.968832:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382035456 00000100:00100000:3.0:1787834218.969153:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1787834218.969165:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:0:x1874679382035072:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787834218.969202:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787834218.969298:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:0:x1874679382035072:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 136us (21866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834218.969305:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1787834218.969325:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1787834218.969332:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18051:x1874679382035456:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787834218.969344:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787834218.969366:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18051:x1874679382035456:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 35us (19991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834218.969372:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:1.0:1787834218.972949:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1787834218.977512:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.977606:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382035584 00000100:00100000:0.0:1787834218.977614:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382035584 00000100:00100000:0.0:1787834218.977673:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:0.0:1787834218.977684:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18051:x1874679382035584:12345-192.168.203.17@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787834218.977794:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18051:x1874679382035584:12345-192.168.203.17@tcp:40:mount.lustre.0 Request processed in 111us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834218.977802:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1787834218.984010:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834218.984054:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834218.984199:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382035712 00000100:00100000:1.0:1787834218.984210:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382035712 00000100:00100000:1.0:1787834218.984266:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382035840 00000100:00100000:1.0:1787834218.984269:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382035840 00000100:00100000:1.0:1787834218.984295:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:1.0:1787834218.984302:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1874679382035712:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787834218.984336:0:24210:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 8eda90af-ee5e-43ad-9f5e-133e0c7073b5@192.168.203.17@tcp t0 exp 0000000000000000 cur 694 last 0 00000020:00000080:1.0:1787834218.984365:0:24210:0:(genops.c:1385:class_connect()) connect: client 8eda90af-ee5e-43ad-9f5e-133e0c7073b5, cookie 0x996d2fb20dc1f1f6 00002000:00100000:1.0:1787834218.984377:0:24210:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8eda90af-ee5e-43ad-9f5e-133e0c7073b5/ffff8df502d4b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787834218.984394:0:24210:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787834218.984545:0:24210:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787834218.984573:0:24210:0:(import.c:65:import_set_state_nolock()) ffff8df502d48000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834218.984631:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2397:x1874679382035712:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 328us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834218.984712:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:1.0:1787834218.984731:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1787834218.984736:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1874679382035840:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787834218.984783:0:24210:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 8eda90af-ee5e-43ad-9f5e-133e0c7073b5@192.168.203.17@tcp t0 exp 0000000000000000 cur 694 last 0 00000020:00000080:1.0:1787834218.984799:0:24210:0:(genops.c:1385:class_connect()) connect: client 8eda90af-ee5e-43ad-9f5e-133e0c7073b5, cookie 0x996d2fb20dc1f1fd 00002000:00100000:1.0:1787834218.984805:0:24210:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8eda90af-ee5e-43ad-9f5e-133e0c7073b5/ffff8df502d4e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787834218.985200:0:24210:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787834218.985319:0:24210:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787834218.985339:0:24210:0:(import.c:65:import_set_state_nolock()) ffff8df502d48800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787834218.985368:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2397:x1874679382035840:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 630us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834218.985375:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1787834218.989920:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834218.990018:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382035968 00000100:00100000:0.0:1787834218.990027:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382035968 00000100:00100000:0.0:1787834218.990077:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:0.0:1787834218.990087:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18051:x1874679382035968:12345-192.168.203.17@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787834218.990177:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18051:x1874679382035968:12345-192.168.203.17@tcp:900:mount.lustre.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834218.990184:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:3.0:1787834218.997315:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834218.997902:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382036096 00000100:00100000:1.0:1787834218.997912:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382036096 00000100:00100000:1.0:1787834218.997965:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1787834218.997984:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18051:x1874679382036096:12345-192.168.203.17@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787834218.999961:0:22707:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1897us 00000004:00200000:1.0:1787834219.011820:0:22707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787834219.011942:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18051:x1874679382036096:12345-192.168.203.17@tcp:33:mount.lustre.0 Request processed in 13964us (14633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834219.011953:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1787834219.200406:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834219.200523:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382036224 00000100:00100000:2.0:1787834219.200532:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382036224 00000100:00100000:2.0:1787834219.200593:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:2.0:1787834219.200604:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18097:x1874679382036224:12345-192.168.203.17@tcp:101:mkdir.0 00010000:00010000:2.0:1787834219.200622:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834219.200647:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1f204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f15e expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834219.200721:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1f20b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834219.200735:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1f20b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834219.200814:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1f20b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834219.200870:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787834219.200874:0:22705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834219.200909:0:22705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1f20b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834219.200936:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1f204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f15e expref: 8 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834219.200954:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1f20b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f15e expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834219.201233:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0b9c00) 00010000:00010000:2.0:1787834219.201237:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787834219.201240:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:2.0:1787834219.201306:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:18097:x1874679382036224:12345-192.168.203.17@tcp:101:mkdir.0 Request processed in 703us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834219.201312:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00010000:00010000:2.0:1787834219.671244:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787834220.253297:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787834220.696589:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834221.399732:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406261376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787834221.399857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834221.400191:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406261504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834221.400224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834221.400281:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406261504 00000100:00100000:0.0:1787834221.400295:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406261504 00000100:00100000:0.0:1787834221.400340:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787834221.400348:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406261504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787834221.400393:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834221.400440:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406261504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.400447:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787834221.400490:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406261504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787834221.400711:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406261376 00000100:00100000:3.0:1787834221.400717:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406261376 00000100:00100000:3.0:1787834221.400782:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834221.400790:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406261376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787834221.400818:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787834221.400854:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406261376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834221.400861:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787834221.400938:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df635a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406261376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787834221.401164:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787834221.401174:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406261248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834221.401201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834221.401296:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406261248 00000100:00100000:2.0:1787834221.401301:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406261248 00000100:00100000:2.0:1787834221.401326:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787834221.401332:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406261248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787834221.401348:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787834221.401393:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406261248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834221.401406:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787834221.401502:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406261248:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787834221.402201:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787834221.442985:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834221.443274:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382036352 00000100:00100000:3.0:1787834221.443283:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382036352 00000100:00100000:3.0:1787834221.443359:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:3.0:1787834221.443378:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:18150:x1874679382036352:12345-192.168.203.17@tcp:41:lfs.0 00000004:00000024:3.0:1787834221.443407:0:23763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787834221.443503:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:18150:x1874679382036352:12345-192.168.203.17@tcp:41:lfs.0 Request processed in 135us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834221.443510:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00080000:0.0:1787834221.444083:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787834221.447109:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834221.448324:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382036480 00000100:00100000:1.0:1787834221.448335:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382036480 00000100:00100000:1.0:1787834221.448424:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:1.0:1787834221.448435:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df635a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18150:x1874679382036480:12345-192.168.203.17@tcp:41:lfs.0 00000004:00000024:1.0:1787834221.448465:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787834221.448565:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df635a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18150:x1874679382036480:12345-192.168.203.17@tcp:41:lfs.0 Request processed in 131us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834221.448573:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00080000:0.0:1787834221.451313:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787834221.454475:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834221.454599:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382036608 00000100:00100000:3.0:1787834221.454608:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382036608 00000100:00100000:3.0:1787834221.454729:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1787834221.454740:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18150:x1874679382036608:12345-192.168.203.17@tcp:13:lfs.0 00002000:00000024:3.0:1787834221.454805:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787834221.454928:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18150:x1874679382036608:12345-192.168.203.17@tcp:13:lfs.0 Request processed in 189us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834221.454935:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00080000:0.0:1787834221.455444:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787834221.462872:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834221.463139:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382036736 00000100:00100000:0.0:1787834221.463148:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382036736 00000100:00100000:0.0:1787834221.463218:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:0.0:1787834221.463228:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e1230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18150:x1874679382036736:12345-192.168.203.17@tcp:13:lfs.0 00002000:00000024:0.0:1787834221.463260:0:24212:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787834221.463352:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e1230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18150:x1874679382036736:12345-192.168.203.17@tcp:13:lfs.0 Request processed in 126us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.463360:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00080000:3.0:1787834221.464596:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787834221.719299:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834221.763367:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834221.763457:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382036864 00000100:00100000:1.0:1787834221.763468:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382036864 00000100:00100000:1.0:1787834221.763527:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 131 00000100:00100000:1.0:1787834221.763537:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+10:18181:x1874679382036864:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787834221.763567:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834221.763584:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030000/0x996d2fb20dc1f212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f165 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834221.763611:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030000/0x996d2fb20dc1f212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f165 expref: 11 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834221.763622:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030000/0x996d2fb20dc1f212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f165 expref: 11 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834221.763631:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030000, rc 0) 00000100:00100000:1.0:1787834221.763690:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18181:x1874679382036864:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 154us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834221.763697:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 131 00000100:00100000:2.0:1787834221.779420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834221.779514:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382036992 00000100:00100000:0.0:1787834221.779524:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382036992 00000100:00100000:0.0:1787834221.779579:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 132 00000100:00100000:0.0:1787834221.779589:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18181:x1874679382036992:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787834221.779747:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18181:x1874679382036992:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 159us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.779800:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 132 00000100:00100000:3.0:1787834221.820968:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834221.821073:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382037120 00000100:00100000:0.0:1787834221.821083:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382037120 00000100:00100000:0.0:1787834221.821149:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:0.0:1787834221.821160:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18181:x1874679382037120:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787834221.821311:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18181:x1874679382037120:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.821318:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:2.0:1787834221.868572:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834221.868672:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382037248 00000100:00100000:1.0:1787834221.868684:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382037248 00000100:00100000:1.0:1787834221.868743:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:1.0:1787834221.868786:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18189:x1874679382037248:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787834221.868958:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18189:x1874679382037248:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 206us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834221.868966:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:0.0:1787834221.910216:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787834221.910239:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60eae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406261632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787834221.910306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834221.910823:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406261760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787834221.910856:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834221.910893:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406261632 00000100:00100000:2.0:1787834221.910900:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406261632 00000100:00100000:2.0:1787834221.910955:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406261760 00000100:00100000:2.0:1787834221.910958:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406261760 00000100:00100000:2.0:1787834221.910978:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787834221.910986:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406261632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787834221.911010:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787834221.911068:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406261632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834221.911075:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787834221.911100:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787834221.911108:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406261760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787834221.911118:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787834221.911146:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406261760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834221.911153:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787834221.911304:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60eae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406261632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787834221.911339:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5047761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406261760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787834221.911352:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406262272:0@lo:400:kworker.0 00000100:00100000:0.0:1787834221.911378:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834221.911397:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406262784:0@lo:400:kworker.0 00000100:00100000:1.0:1787834221.911398:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406261888:0@lo:400:kworker.0 00000100:00100000:2.0:1787834221.911456:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406262144:0@lo:400:kworker.0 00000100:00080000:3.0:1787834221.911496:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787834221.911508:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406262272 00000100:00100000:3.0:1787834221.911511:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406262272 00000100:00100000:3.0:1787834221.911555:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787834221.911563:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406262272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834221.912418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834221.912458:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787834221.912467:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df60e1212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406262912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787834221.912503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834221.912537:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406262912 00000100:00100000:0.0:1787834221.912542:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406262912 00000100:00100000:0.0:1787834221.912584:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834221.912590:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406262912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787834221.912634:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787834221.912806:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406262912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.912814:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787834221.912851:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df60e1212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406262912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787834221.912875:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406262784 00000100:00100000:0.0:1787834221.912878:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406262784 00000100:00100000:0.0:1787834221.912906:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787834221.912913:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406262784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834221.912950:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874679406262784:12345-0@lo:400:kworker.0 Request processed in 38us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.912957:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787834221.912983:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6329a9a40 x1874679406262784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834221.912994:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874679406262784:0@lo:400:kworker.0 00000100:00100000:0.0:1787834221.913047:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406262016:0@lo:400:kworker.0 00000100:00100000:0.0:1787834221.913076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834221.913106:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406262528:0@lo:400:kworker.0 00000100:00100000:0.0:1787834221.913128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834221.913156:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406262016 00000100:00100000:0.0:1787834221.913159:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406262016 00000100:00100000:0.0:1787834221.913186:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834221.913192:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60eae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406262016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834221.913226:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406262016:12345-0@lo:400:kworker.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.913240:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787834221.913261:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406262528 00000100:00100000:0.0:1787834221.913264:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406262528 00000100:00100000:0.0:1787834221.913285:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787834221.913291:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406262528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787834221.913320:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874679406262528:12345-0@lo:400:kworker.0 Request processed in 29us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.913325:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787834221.913351:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406262016:0@lo:400:kworker.0 00010000:00080000:0.0:1787834221.913361:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6329a83c0 x1874679406262528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787834221.913370:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874679406262528:0@lo:400:kworker.0 00000100:00100000:2.0:1787834221.919561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834221.919939:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834221.920159:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406261888 00000100:00100000:0.0:1787834221.920168:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406261888 00000100:00100000:0.0:1787834221.920218:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787834221.920229:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3641:x1874679406261888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834221.921246:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406262400:0@lo:400:kworker.0 00000100:00100000:1.0:1787834221.921297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834221.921499:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406262656:0@lo:400:kworker.0 00000100:00100000:2.0:1787834221.921544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834221.921581:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406262144 00000100:00100000:2.0:1787834221.921587:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406262144 00000100:00100000:2.0:1787834221.921617:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406262400 00000100:00100000:2.0:1787834221.921619:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406262400 00000100:00100000:2.0:1787834221.921635:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406262656 00000100:00100000:2.0:1787834221.921637:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406262656 00000100:00100000:2.0:1787834221.921651:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787834221.921668:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406262144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787834221.921718:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406262144:12345-0@lo:400:kworker.0 Request processed in 61us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834221.921741:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787834221.922084:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787834221.922110:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406262400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834221.922150:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874679406262400:12345-0@lo:400:kworker.0 Request processed in 42us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834221.922157:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787834221.922171:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787834221.922178:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406262656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834221.922205:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874679406262656:12345-0@lo:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834221.922211:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787834221.922247:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874679406262400:0@lo:400:kworker.0 00000100:00080000:2.0:1787834221.922311:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787834221.922315:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787834221.922318:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787834221.922508:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406262144:0@lo:400:kworker.0 00000100:00100000:1.0:1787834221.922522:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874679406262656:0@lo:400:kworker.0 00000100:00100000:0.0:1787834221.923016:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3641:x1874679406261888:12345-0@lo:400:kworker.0 Request processed in 2787us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.923088:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787834221.923177:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9903e54-1448-45ce-bd63-f50f2c84e331:3641:1874679406261888:0@lo:400:kworker.0 00000100:00100000:3.0:1787834221.923349:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60eae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874679406262272:12345-0@lo:400:kworker.0 Request processed in 11775us (11958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834221.923357:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787834221.923467:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874679406262272:0@lo:400:kworker.0 00000100:00100000:2.0:1787834221.943594:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834221.943959:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382037376 00000100:00100000:0.0:1787834221.943969:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382037376 00000100:00100000:0.0:1787834221.944034:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:0.0:1787834221.944044:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18189:x1874679382037376:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787834221.944366:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18189:x1874679382037376:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 323us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.944374:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:3.0:1787834221.958274:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834221.959716:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382037504 00000100:00100000:0.0:1787834221.959728:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382037504 00000100:00100000:0.0:1787834221.960218:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:0.0:1787834221.960230:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18189:x1874679382037504:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787834221.960383:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18189:x1874679382037504:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 154us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.960392:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:0.0:1787834221.973578:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834221.974380:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382037632 00000100:00100000:1.0:1787834221.974390:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382037632 00000100:00100000:1.0:1787834221.974452:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:1.0:1787834221.974462:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18181:x1874679382037632:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787834221.974479:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834221.974496:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600031200/0x996d2fb20dc1f219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f196 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834221.974533:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031200/0x996d2fb20dc1f219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f196 expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834221.974545:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600031200/0x996d2fb20dc1f219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f196 expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834221.974567:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031200, rc 0) 00000100:00100000:1.0:1787834221.974623:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18181:x1874679382037632:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 162us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834221.974630:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:2.0:1787834221.988966:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834221.989303:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382037760 00000100:00100000:0.0:1787834221.989314:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382037760 00000100:00100000:0.0:1787834221.989373:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 139 00000100:00100000:0.0:1787834221.989383:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18181:x1874679382037760:12345-192.168.203.17@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787834221.989409:0:22700:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787834221.989435:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787834221.989439:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787834221.989442:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787834221.989445:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787834221.989448:0:22700:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1787834221.996486:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18181:x1874679382037760:12345-192.168.203.17@tcp:256:mount.lustre.0 Request processed in 7094us (7518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834221.996500:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 139 00000100:00100000:2.0:1787834222.008321:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834222.008513:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382037888 00000100:00100000:0.0:1787834222.008522:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382037888 00000100:00100000:0.0:1787834222.008586:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 140 00000100:00100000:0.0:1787834222.008597:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18181:x1874679382037888:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787834222.008614:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834222.008631:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f19d expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834222.008659:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f19d expref: 13 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834222.008670:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f19d expref: 13 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834222.008679:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246800, rc 0) 00000100:00100000:0.0:1787834222.008739:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18181:x1874679382037888:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 143us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834222.008746:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 140 00000100:00100000:2.0:1787834222.013813:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834222.014029:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382038016 00000100:00100000:0.0:1787834222.014039:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382038016 00000100:00100000:0.0:1787834222.014112:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:0.0:1787834222.014122:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18181:x1874679382038016:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787834222.014273:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18181:x1874679382038016:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 151us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834222.014281:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:3.0:1787834222.021212:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834222.021323:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382038144 00000100:00100000:0.0:1787834222.021333:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382038144 00000100:00100000:0.0:1787834222.021402:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:0.0:1787834222.021413:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18181:x1874679382038144:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787834222.021585:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18181:x1874679382038144:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 173us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834222.021594:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:2.0:1787834222.035346:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834222.038294:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382038272 00000100:00100000:1.0:1787834222.038308:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382038272 00000100:00100000:1.0:1787834222.038384:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 143 00000100:00100000:1.0:1787834222.038394:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18197:x1874679382038272:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787834222.038553:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18197:x1874679382038272:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 159us (3214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834222.038561:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 143 00000100:00100000:2.0:1787834222.054850:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834222.057077:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382038400 00000100:00100000:1.0:1787834222.057101:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382038400 00000100:00100000:1.0:1787834222.057173:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 144 00000100:00100000:1.0:1787834222.057183:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18197:x1874679382038400:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787834222.057342:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18197:x1874679382038400:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 159us (2501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834222.057350:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 144 00000100:00100000:3.0:1787834222.068831:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834222.068871:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834222.068905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834222.068927:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834222.068950:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834222.068987:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834222.069015:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382039424 00000100:00100000:3.0:1787834222.069035:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382039424 00000100:00100000:3.0:1787834222.069326:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382039552 00000100:00100000:3.0:1787834222.069331:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382039552 00000100:00100000:3.0:1787834222.069355:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1787834222.069364:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e1212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2400:x1874679382039424:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834222.069432:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e1212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2400:x1874679382039424:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 68us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834222.069439:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1787834222.069472:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1787834222.069479:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2400:x1874679382039552:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834222.069506:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2400:x1874679382039552:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834222.069513:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1787834222.069534:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382038528 00000100:00100000:3.0:1787834222.069537:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382038528 00000100:00100000:3.0:1787834222.069549:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382039168 00000100:00100000:3.0:1787834222.069551:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382039168 00000100:00100000:3.0:1787834222.069564:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382039296 00000100:00100000:3.0:1787834222.069566:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382039296 00000100:00100000:3.0:1787834222.069577:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382038784 00000100:00100000:3.0:1787834222.069579:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382038784 00000100:00100000:3.0:1787834222.069590:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:3.0:1787834222.069597:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:2400:x1874679382039168:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834222.069625:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e120f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:2400:x1874679382039168:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 29us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834222.069631:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:2.0:1787834222.081918:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:2.0:1787834222.081945:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2400:x1874679382039296:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834222.082023:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2400:x1874679382039296:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 94us (13095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834222.082032:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:2.0:1787834222.082075:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1787834222.082080:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df60e123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1874679382038528:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787834222.082124:0:22704:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 13c826df-92c7-455c-8f83-bbbfe462702e@192.168.203.17@tcp t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:2.0:1787834222.082160:0:22704:0:(genops.c:1385:class_connect()) connect: client 13c826df-92c7-455c-8f83-bbbfe462702e, cookie 0x996d2fb20dc1f227 00000004:00100000:2.0:1787834222.082184:0:22704:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787834222.082277:0:22704:0:(import.c:65:import_set_state_nolock()) ffff8df637644000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834222.082306:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df60e123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+6:2397:x1874679382038528:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 225us (13487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834222.082314:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1787834222.082327:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1787834222.082331:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1874679382038784:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787834222.082346:0:22704:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 13c826df-92c7-455c-8f83-bbbfe462702e@192.168.203.17@tcp t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:2.0:1787834222.082366:0:22704:0:(genops.c:1385:class_connect()) connect: client 13c826df-92c7-455c-8f83-bbbfe462702e, cookie 0x996d2fb20dc1f22e 00000004:00100000:2.0:1787834222.082377:0:22704:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787834222.082417:0:22704:0:(import.c:65:import_set_state_nolock()) ffff8df637644800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787834222.082439:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+6:2397:x1874679382038784:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 106us (13452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834222.082446:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:0.0:1787834222.091851:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834222.091902:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834222.091924:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834222.091943:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382039040 00000100:00100000:0.0:1787834222.091951:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382039040 00000100:00100000:0.0:1787834222.091989:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382038656 00000100:00100000:0.0:1787834222.091991:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382038656 00000100:00100000:0.0:1787834222.091999:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382038912 00000100:00100000:0.0:1787834222.092001:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382038912 00000100:00100000:0.0:1787834222.092017:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:0.0:1787834222.092025:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+7:18181:x1874679382039040:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787834222.092080:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787834222.092155:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63fcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+7:18181:x1874679382039040:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 130us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834222.092162:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:0.0:1787834222.092184:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:0.0:1787834222.092190:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b036d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+6:0:x1874679382038656:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787834222.092202:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787834222.092226:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b036d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+6:0:x1874679382038656:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 35us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834222.092231:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:0.0:1787834222.092242:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:0.0:1787834222.092248:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b036940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+6:0:x1874679382038912:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787834222.092271:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834222.092298:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b036940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+6:0:x1874679382038912:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 50us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834222.092304:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00080000:0.0:1787834222.092412:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787834222.092416:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787834222.102988:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834222.103082:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382039680 00000100:00100000:0.0:1787834222.103100:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382039680 00000100:00100000:0.0:1787834222.103158:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787834222.103168:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+6:18181:x1874679382039680:12345-192.168.203.17@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787834222.103262:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+6:18181:x1874679382039680:12345-192.168.203.17@tcp:40:mount.lustre.0 Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834222.103270:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787834222.106063:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834222.106690:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834222.106799:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834222.106930:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382039808 00000100:00100000:3.0:1787834222.106939:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382039808 00000100:00100000:3.0:1787834222.106978:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382039936 00000100:00100000:3.0:1787834222.106981:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382039936 00000100:00100000:3.0:1787834222.107003:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1787834222.107010:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50568fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1874679382039808:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787834222.107044:0:24209:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 13c826df-92c7-455c-8f83-bbbfe462702e@192.168.203.17@tcp t0 exp 0000000000000000 cur 698 last 0 00000020:00000080:3.0:1787834222.107087:0:24209:0:(genops.c:1385:class_connect()) connect: client 13c826df-92c7-455c-8f83-bbbfe462702e, cookie 0x996d2fb20dc1f235 00002000:00100000:3.0:1787834222.107108:0:24209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 13c826df-92c7-455c-8f83-bbbfe462702e/ffff8df637627800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787834222.107131:0:24209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787834222.107194:0:24209:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787834222.107222:0:24209:0:(import.c:65:import_set_state_nolock()) ffff8df637623000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834222.107275:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50568fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13c826df-92c7-455c-8f83-bbbfe462702e+6:2397:x1874679382039808:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 263us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834222.107283:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1787834222.107300:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:3.0:1787834222.107304:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df620950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1874679382039936:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787834222.107321:0:24209:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 13c826df-92c7-455c-8f83-bbbfe462702e@192.168.203.17@tcp t0 exp 0000000000000000 cur 698 last 0 00000020:00000080:3.0:1787834222.107336:0:24209:0:(genops.c:1385:class_connect()) connect: client 13c826df-92c7-455c-8f83-bbbfe462702e, cookie 0x996d2fb20dc1f23c 00002000:00100000:3.0:1787834222.107341:0:24209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 13c826df-92c7-455c-8f83-bbbfe462702e/ffff8df637620000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787834222.107346:0:24209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787834222.107374:0:24209:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787834222.107387:0:24209:0:(import.c:65:import_set_state_nolock()) ffff8df637626000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787834222.107408:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df620950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13c826df-92c7-455c-8f83-bbbfe462702e+6:2397:x1874679382039936:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 102us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834222.107414:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:1.0:1787834222.107775:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382040064 00000100:00100000:1.0:1787834222.107781:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382040064 00000100:00100000:1.0:1787834222.107822:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:1.0:1787834222.107829:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b034780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13c826df-92c7-455c-8f83-bbbfe462702e+6:18181:x1874679382040064:12345-192.168.203.17@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787834222.107865:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b034780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13c826df-92c7-455c-8f83-bbbfe462702e+6:18181:x1874679382040064:12345-192.168.203.17@tcp:900:mount.lustre.0 Request processed in 37us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834222.107882:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:0.0:1787834222.122412:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834222.122889:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382040192 00000100:00100000:1.0:1787834222.122899:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382040192 00000100:00100000:1.0:1787834222.123182:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:1.0:1787834222.123195:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b0370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13c826df-92c7-455c-8f83-bbbfe462702e+6:18181:x1874679382040192:12345-192.168.203.17@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787834222.123283:0:22708:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787834222.123368:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b0370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13c826df-92c7-455c-8f83-bbbfe462702e+6:18181:x1874679382040192:12345-192.168.203.17@tcp:33:mount.lustre.0 Request processed in 175us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834222.123376:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:2.0:1787834222.339084:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834222.339238:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382040320 00000100:00100000:3.0:1787834222.339248:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382040320 00000100:00100000:3.0:1787834222.339311:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:3.0:1787834222.339322:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13c826df-92c7-455c-8f83-bbbfe462702e+6:18220:x1874679382040320:12345-192.168.203.17@tcp:101:mkdir.0 00010000:00010000:3.0:1787834222.339339:0:23763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834222.339362:0:23763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f1ce expref: -99 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834222.339444:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834222.339459:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834222.339473:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834222.339518:0:23763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787834222.339523:0:23763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787834222.339544:0:23763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834222.339570:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ce expref: 8 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834222.339602:0:23763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ce expref: 7 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834222.339610:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0b9c00) 00010000:00010000:3.0:1787834222.339612:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787834222.339616:0:23763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722000, rc 0) 00000100:00100000:3.0:1787834222.339691:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13c826df-92c7-455c-8f83-bbbfe462702e+7:18220:x1874679382040320:12345-192.168.203.17@tcp:101:mkdir.0 Request processed in 371us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834222.339698:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000040:00080000:2.0:1787834222.550444:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787834222.741899:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834223.768921:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834224.790185:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787834224.984288:0:24205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 13c826df-92c7-455c-8f83-bbbfe462702e 00000001:00100000:1.0:1787834224.984304:0:24205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8eda90af-ee5e-43ad-9f5e-133e0c7073b5 00000001:00100000:1.0:1787834224.985436:0:23436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 13c826df-92c7-455c-8f83-bbbfe462702e 00000001:00100000:1.0:1787834224.985450:0:23436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8eda90af-ee5e-43ad-9f5e-133e0c7073b5 00000001:00100000:1.0:1787834224.985881:0:22685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 13c826df-92c7-455c-8f83-bbbfe462702e 00000001:00100000:1.0:1787834224.985890:0:22685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8eda90af-ee5e-43ad-9f5e-133e0c7073b5 00000001:00100000:2.0:1787834224.992494:0:25026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 13c826df-92c7-455c-8f83-bbbfe462702e 00000001:00100000:2.0:1787834224.992510:0:25026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8eda90af-ee5e-43ad-9f5e-133e0c7073b5 00010000:00010000:0.0:1787834225.814696:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787834226.011992:0:25585:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787834226.518110:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63b034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406263040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834226.518209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834226.518359:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406263040 00000100:00100000:0.0:1787834226.518368:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406263040 00000100:00100000:0.0:1787834226.518434:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787834226.518445:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406263040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787834226.518494:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787834226.518561:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5025092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406263040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834226.518569:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787834226.518634:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63b034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406263040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787834226.518658:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787834226.518683:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406263168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787834226.518714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834226.518867:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406263168 00000100:00100000:0.0:1787834226.518877:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406263168 00000100:00100000:0.0:1787834226.518898:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787834226.518904:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df602c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406263168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787834226.518924:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787834226.518969:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df602c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406263168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834226.518976:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787834226.519095:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406263168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834226.520200:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406263296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787834226.520264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834226.520365:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406263296 00000100:00100000:2.0:1787834226.520373:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406263296 00000100:00100000:2.0:1787834226.520446:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787834226.520456:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406263296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787834226.520488:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834226.520539:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406263296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834226.520547:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787834226.520592:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406263296:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787834226.520659:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787834226.839155:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834227.030151:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406263808:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.030249:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.030307:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406264320:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.030332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.030364:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787834227.030370:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406263424:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.030402:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.030432:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406263936:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.030461:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.030478:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406264448:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.030506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.030538:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406263808 00000100:00100000:3.0:1787834227.030547:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406263808 00000100:00100000:3.0:1787834227.030609:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406264320 00000100:00100000:3.0:1787834227.030613:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406264320 00000100:00100000:3.0:1787834227.030638:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406264448 00000100:00100000:3.0:1787834227.030641:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406264448 00000100:00100000:3.0:1787834227.030670:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787834227.030679:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406263808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.030742:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874679406263808:12345-0@lo:400:kworker.0 Request processed in 64us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.030796:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787834227.030818:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787834227.030839:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406264320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.030871:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874679406264320:12345-0@lo:400:kworker.0 Request processed in 34us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.030877:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787834227.030892:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787834227.030898:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406264448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.030924:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874679406264448:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.030930:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787834227.030956:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406263424 00000100:00100000:3.0:1787834227.030959:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406263424 00000100:00100000:3.0:1787834227.030986:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787834227.030993:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df632aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3640:x1874679406263424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031023:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df632aa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3640:x1874679406263424:12345-0@lo:400:kworker.0 Request processed in 31us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.031029:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1787834227.031077:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787834227.031082:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787834227.031095:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406263552:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031124:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.031145:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406264064:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.031178:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406264576:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.031225:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787834227.031231:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406263680:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.031279:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406264192:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031298:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834227.031325:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406263936 00000100:00100000:3.0:1787834227.031328:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406263936 00000100:00100000:3.0:1787834227.031362:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406263552 00000100:00100000:3.0:1787834227.031366:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406263552 00000100:00100000:3.0:1787834227.031383:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406263680 00000100:00100000:3.0:1787834227.031386:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406263680 00000100:00100000:3.0:1787834227.031401:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787834227.031408:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406263936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031444:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406263936:12345-0@lo:400:kworker.0 Request processed in 36us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.031451:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787834227.031464:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787834227.031483:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406263552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031515:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406263552:12345-0@lo:400:kworker.0 Request processed in 46us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.031521:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787834227.031533:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834227.031539:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406263680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031564:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406263680:12345-0@lo:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.031570:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834227.031593:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406264064 00000100:00100000:3.0:1787834227.031597:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406264064 00000100:00100000:3.0:1787834227.031619:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406264576 00000100:00100000:3.0:1787834227.031629:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406264576 00000100:00100000:3.0:1787834227.031647:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406264192 00000100:00100000:3.0:1787834227.031649:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406264192 00000100:00100000:3.0:1787834227.031661:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787834227.031667:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406264064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031699:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874679406264064:12345-0@lo:400:kworker.0 Request processed in 32us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.031705:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787834227.031717:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787834227.031722:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406264576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031780:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874679406264576:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.031787:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787834227.031799:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787834227.031806:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406264192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031833:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874679406264192:12345-0@lo:400:kworker.0 Request processed in 28us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.031839:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787834227.031855:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787834227.031859:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787834227.031862:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787834227.031865:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787834227.031906:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406263680:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031918:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874679406264192:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031930:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406263552:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.031939:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874679406264064:0@lo:400:kworker.0 00010000:00080000:3.0:1787834227.031961:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df602c212c0 x1874679406264576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834227.031972:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874679406264576:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.032016:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406263424:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.032029:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c21680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406263936:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.032041:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874679406264448:0@lo:400:kworker.0 00000100:00100000:3.0:1787834227.032053:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874679406263808:0@lo:400:kworker.0 00010000:00080000:3.0:1787834227.032074:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df602c221c0 x1874679406264320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834227.032084:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df602c221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874679406264320:0@lo:400:kworker.0 00000100:00100000:2.0:1787834227.036468:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787834227.036501:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406264704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787834227.036603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834227.036687:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406264704 00000100:00100000:2.0:1787834227.036696:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406264704 00000100:00100000:2.0:1787834227.036781:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787834227.036792:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406264704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787834227.036833:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787834227.036887:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406264704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834227.036896:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787834227.036969:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406264704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787834227.041218:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787834227.041264:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406264832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787834227.041379:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834227.041646:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406264832 00000100:00100000:2.0:1787834227.041666:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406264832 00000100:00100000:2.0:1787834227.042003:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787834227.042044:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b035e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406264832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787834227.042088:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787834227.042173:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b035e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406264832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834227.042180:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787834227.048781:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406264832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787834227.052329:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787834227.052361:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63b034b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406264960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787834227.052449:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834227.052547:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406264960 00000100:00100000:0.0:1787834227.052556:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406264960 00000100:00100000:0.0:1787834227.052612:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787834227.052621:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406264960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787834227.052644:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787834227.052701:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874679406264960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834227.052710:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787834227.052958:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63b034b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874679406264960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787834227.259280:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834227.259444:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382040448 00000100:00100000:2.0:1787834227.259455:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382040448 00000100:00100000:2.0:1787834227.259515:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:2.0:1787834227.259525:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:2400:x1874679382040448:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834227.259616:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:2400:x1874679382040448:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 91us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834227.259624:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:0.0:1787834227.265274:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834227.265686:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382040576 00000100:00100000:3.0:1787834227.265696:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382040576 00000100:00100000:3.0:1787834227.265803:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:3.0:1787834227.265814:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b0361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2400:x1874679382040576:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1787834227.265903:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b0361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2400:x1874679382040576:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 91us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834227.265922:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00080000:0.0:1787834227.266142:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787834227.282946:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834227.282996:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834227.283031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834227.283074:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382040704 00000100:00100000:0.0:1787834227.283075:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834227.283085:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382040704 00000100:00100000:0.0:1787834227.283101:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834227.283131:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834227.283189:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382041088 00000100:00100000:0.0:1787834227.283189:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834227.283196:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382041088 00000100:00100000:0.0:1787834227.283218:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382040832 00000100:00100000:0.0:1787834227.283223:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382040832 00000100:00100000:1.0:1787834227.283225:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382041216 00000100:00100000:1.0:1787834227.283231:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382041216 00000100:00100000:1.0:1787834227.283250:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:1.0:1787834227.283259:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b0343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2400:x1874679382040704:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834227.283331:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b0343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2400:x1874679382040704:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 73us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834227.283347:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:1.0:1787834227.283365:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:1.0:1787834227.283370:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b035a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+6:2401:x1874679382041088:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834227.283393:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b035a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+6:2401:x1874679382041088:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834227.283399:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:1.0:1787834227.283410:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:1.0:1787834227.283415:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b035680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+5:2400:x1874679382041216:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834227.283431:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b035680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+5:2400:x1874679382041216:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 17us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834227.283437:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:1.0:1787834227.283539:0:25150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382041344 00000100:00100000:0.0:1787834227.283540:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382040960 00000100:00100000:1.0:1787834227.283544:0:25150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382041344 00000100:00100000:0.0:1787834227.283546:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382040960 00000100:00100000:1.0:1787834227.283568:0:25150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382041472 00000100:00100000:1.0:1787834227.283572:0:25150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382041472 00000100:00100000:0.0:1787834227.283578:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1787834227.283594:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b034f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2401:x1874679382040832:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834227.283633:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b034f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2401:x1874679382040832:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 41us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834227.284451:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:1.0:1787834227.284460:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b0352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:13c826df-92c7-455c-8f83-bbbfe462702e+5:2401:x1874679382041344:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834227.284495:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b0352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:13c826df-92c7-455c-8f83-bbbfe462702e+5:2401:x1874679382041344:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834227.284502:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:0.0:1787834227.284510:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:1.0:1787834227.284519:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:1.0:1787834227.284528:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b036580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2400:x1874679382040960:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1787834227.284534:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1787834227.284545:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b037c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13c826df-92c7-455c-8f83-bbbfe462702e+5:2400:x1874679382041472:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1787834227.284554:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b036580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2400:x1874679382040960:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834227.284569:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:0.0:1787834227.284592:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b037c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13c826df-92c7-455c-8f83-bbbfe462702e+5:2400:x1874679382041472:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 48us (1402us total) trans 0 rc 0/0 00000100:00080000:1.0:1787834227.284596:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787834227.284601:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787834227.284602:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00080000:1.0:1787834227.284607:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787834227.284611:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787834227.862947:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834228.890134:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787834229.723673:0:25732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceab7ab10 20000000:00000080:1.0:1787834229.723690:0:25732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8df6376a8400 uarg=0000000000000000 20000000:01000000:1.0:1787834229.723732:0:25732:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787834229.723737:0:25732:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787834229.723741:0:25732:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787834229.725182:0:25733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1787834229.727782:0:25732:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787834229.736106:0:25732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787834229.736147:0:25732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736166:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1eea7 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736174:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1eeb5 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736181:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1eef4 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736188:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1ef8e expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736197:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f12d expref: 12 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736220:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f19d expref: 12 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736228:0:25732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736272:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f19d expref: 12 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736288:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f19d expref: 12 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834229.736303:0:25732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265088:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787834229.736392:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f12d expref: 12 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736401:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f12d expref: 12 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834229.736410:0:25732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329a8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265216:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787834229.736442:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1ef8e expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736451:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef8e expref: 23 pid: 22699 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834229.736459:0:25732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329a9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265344:0@lo:104: 00000100:00100000:1.0:1787834229.736499:0:25732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834229.736597:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1eef4 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736606:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1eef4 expref: 23 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834229.736614:0:25732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329ab840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265472:0@lo:104: 00000100:00100000:1.0:1787834229.736635:0:25732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787834229.736865:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1eeb5 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.736873:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1eeb5 expref: 23 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834229.736881:0:25732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6329a92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265600:0@lo:104: 00000100:00100000:1.0:1787834229.736901:0:25732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834229.736961:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406265344 00000100:00100000:3.0:1787834229.736973:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406265344 00000100:00100000:3.0:1787834229.737007:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406265472 00000100:00100000:3.0:1787834229.737009:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406265472 00000100:00100000:3.0:1787834229.737023:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834229.737031:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+4:25732:x1874679406265344:12345-0@lo:104: 00010000:00010000:3.0:1787834229.737052:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.737098:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787834229.737103:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+4:25732:x1874679406265344:12345-0@lo:104: Request processed in 74us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834229.737110:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787834229.737128:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787834229.737134:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:25732:x1874679406265472:12345-0@lo:104: 00010000:00010000:3.0:1787834229.737141:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.737180:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787834229.737186:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:25732:x1874679406265472:12345-0@lo:104: Request processed in 53us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834229.737191:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787834229.737253:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787834229.737260:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737267:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676600 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834229.737271:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737288:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834229.737295:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834229.737301:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787834229.737327:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737333:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787834229.737350:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737357:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504676600/0x996d2fb20dc1ef8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1ef95 expref: -99 pid: 25025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737368:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787834229.737371:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737376:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df504676c00 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:0.0:1787834229.737378:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737384:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787834229.737390:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834229.737401:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787834229.737413:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737418:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787834229.737423:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737429:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df504676c00/0x996d2fb20dc1eef4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1eefb expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737436:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834229.737438:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787834229.737439:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787834229.737457:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63b034b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406265728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834229.737486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834229.737509:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787834229.737514:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63b034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406265856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834229.737545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834229.737574:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406265728 00000100:00100000:0.0:1787834229.737578:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406265728 00010000:00010000:0.0:1787834229.737595:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef8e expref: 24 pid: 22699 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834229.737613:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406265856 00000100:00100000:0.0:1787834229.737616:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406265856 00010000:00010000:0.0:1787834229.737626:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1eef4 expref: 25 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834229.737653:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787834229.737659:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63b037840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+25:3638:x1874679406265728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834229.737680:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834229.737686:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef8e expref: 25 pid: 22699 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737695:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1ef8e expref: 25 pid: 22699 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737711:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834229.737737:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63b037840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+25:3638:x1874679406265728:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834229.737777:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787834229.737790:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787834229.737796:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3638:x1874679406265856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834229.737812:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834229.737816:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1eef4 expref: 24 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737824:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1eef4 expref: 24 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.737833:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834229.737853:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3638:x1874679406265856:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834229.737858:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787834229.737894:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63b034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406265856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834229.737910:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63b034b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9903e54-1448-45ce-bd63-f50f2c84e331:3638:1874679406265728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834229.738035:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787834229.738507:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x996d2fb20dc1eea7 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.738518:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x996d2fb20dc1eea7 expref: 23 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834229.738527:0:25732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dc9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265984:0@lo:104: 00000100:00100000:1.0:1787834229.738553:0:25732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834229.738564:0:25732:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df634387d80 going to sleep for 11 seconds 00010000:00010000:1.0:1787834229.738576:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b6800/0x996d2fb20dc1ef95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1ef8e expref: 23 pid: 22699 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834229.738586:0:25732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329a9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265344:0@lo:104: 00010000:00010000:1.0:1787834229.738594:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df5044b7a00/0x996d2fb20dc1eefb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1eef4 expref: 22 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834229.738608:0:25732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329ab840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265472:0@lo:104: 00000100:00100000:3.0:1787834229.738985:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406265600 00000100:00100000:3.0:1787834229.738991:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406265600 00000100:00100000:3.0:1787834229.739019:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406265984 00000100:00100000:3.0:1787834229.739022:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406265984 00000100:00100000:3.0:1787834229.739035:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787834229.739054:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6329a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+4:25732:x1874679406265600:12345-0@lo:104: 00010000:00010000:3.0:1787834229.739064:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739121:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787834229.739127:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6329a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+4:25732:x1874679406265600:12345-0@lo:104: Request processed in 75us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834229.739133:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787834229.739148:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787834229.739154:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:25732:x1874679406265984:12345-0@lo:104: 00010000:00010000:3.0:1787834229.739161:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739193:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787834229.739198:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+3:25732:x1874679406265984:12345-0@lo:104: Request processed in 45us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834229.739204:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787834229.739219:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787834229.739224:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739231:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b6400 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787834229.739235:0:22694:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739242:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787834229.739249:0:22694:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834229.739254:0:22694:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787834229.739284:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739290:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787834229.739309:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739315:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b6400/0x996d2fb20dc1eeb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1eebc expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739324:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834229.739327:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739332:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df5044b7200 already unused, calling callback (ffffffffc1230c20) 10000000:00010000:3.0:1787834229.739335:0:22694:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739342:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787834229.739348:0:22694:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787834229.739353:0:22694:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787834229.739365:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739370:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787834229.739376:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739392:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffff8df5044b7200/0x996d2fb20dc1eea7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x996d2fb20dc1eeae expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.739404:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834229.739406:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834229.739408:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787834229.739419:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406266112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834229.739447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834229.739466:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787834229.739471:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406266240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787834229.739491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787834229.739513:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834229.739828:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834229.739864:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406266112 00000100:00100000:0.0:1787834229.739869:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406266112 00010000:00010000:0.0:1787834229.739887:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1eeb5 expref: 22 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834229.739917:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406266240 00000100:00100000:0.0:1787834229.739920:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406266240 00010000:00010000:0.0:1787834229.739931:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1eea7 expref: 23 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834229.739941:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382041600 00000100:00100000:0.0:1787834229.739943:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382041600 00010000:00010000:0.0:1787834229.739953:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f19d expref: 13 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834229.739965:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787834229.739971:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9903e54-1448-45ce-bd63-f50f2c84e331+23:3640:x1874679406266112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834229.739980:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834229.739985:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1eeb5 expref: 23 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.739994:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1eeb5 expref: 23 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834229.740009:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834229.740016:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787834229.740025:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+23:3640:x1874679406266240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787834229.740033:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834229.740045:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x996d2fb20dc1eea7 expref: 23 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.740058:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x996d2fb20dc1eea7 expref: 23 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.740068:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834229.740096:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9903e54-1448-45ce-bd63-f50f2c84e331+23:3640:x1874679406266240:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834229.740102:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787834229.740118:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:3.0:1787834229.740124:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:2401:x1874679382041600:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787834229.740139:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834229.740144:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f19d expref: 13 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.740153:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f19d expref: 13 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.740163:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834229.740170:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9903e54-1448-45ce-bd63-f50f2c84e331+22:3640:x1874679406266112:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834229.740175:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787834229.740192:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:2401:x1874679382041600:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 69us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834229.740198:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00010000:00010000:0.0:1787834229.740223:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b246800/0x996d2fb20dc1f220 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f19d expref: 12 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834229.740233:0:25732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265088:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787834229.740239:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406266240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787834229.740242:0:25732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329a8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265216:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787834229.740246:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9903e54-1448-45ce-bd63-f50f2c84e331:3640:1874679406266112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787834229.740250:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3ba00/0x996d2fb20dc1eebc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1eeb5 expref: 21 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834229.740256:0:25732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6329a92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265600:0@lo:104: 00010000:00010000:0.0:1787834229.740265:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df503c3ae00/0x996d2fb20dc1eeae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x996d2fb20dc1eea7 expref: 20 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834229.740272:0:25732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dc9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1874679406265984:0@lo:104: 00010000:00010000:0.0:1787834229.740299:0:25732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834229.742553:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834229.742952:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382041728 00000100:00100000:2.0:1787834229.742962:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382041728 00010000:00010000:2.0:1787834229.743000:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f12d expref: 12 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834229.743085:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:2.0:1787834229.743095:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:2398:x1874679382041728:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787834229.743108:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834229.743114:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f12d expref: 12 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743142:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f12d expref: 12 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743160:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df63b247600/0x996d2fb20dc1f1e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f12d expref: 12 pid: 22698 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743173:0:22692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743181:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743197:0:22692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743204:0:22692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743212:0:22692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743218:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743224:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031800 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:2.0:1787834229.743227:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743234:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743268:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834229.743279:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834229.743336:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:2398:x1874679382041728:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 242us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834229.743344:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00010000:00010000:1.0:1787834229.744956:0:25732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.744970:0:25732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834229.744977:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8df600031800/0x996d2fb20dc1f251 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834229.916223:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787834230.486975:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787834230.934171:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787834231.083446:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834231.083573:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382041856 00000100:00100000:2.0:1787834231.083582:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382041856 00000100:00100000:2.0:1787834231.083660:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:2.0:1787834231.083672:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:18688:x1874679382041856:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787834231.083692:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834231.083712:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f1d5 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.083797:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.083811:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.083823:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.083837:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.083843:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.083872:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.083950:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1f26d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.083958:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1f26d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.083965:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1f26d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834231.083993:0:22704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787834231.083998:0:22704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834231.084361:0:22704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1f26d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084373:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084380:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084387:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084393:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4e800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834231.084397:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084404:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084432:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0b9c00) 00010000:00010000:2.0:1787834231.084435:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834231.084439:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084446:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f25f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084458:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084465:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084471:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084476:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4fc00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834231.084479:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084485:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084491:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8df634802e00) 00010000:00010000:2.0:1787834231.084493:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834231.084496:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084502:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f266 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084541:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1d5 expref: 8 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084553:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4f600/0x996d2fb20dc1f26d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1d5 expref: 7 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.084561:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df634802900) 00010000:00010000:2.0:1787834231.084563:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787834231.084565:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4f600, rc 0) 00000100:00100000:2.0:1787834231.084620:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:18688:x1874679382041856:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 952us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834231.084629:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00080000:1.0:1787834231.087519:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787834231.091921:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834231.092087:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382041984 00000100:00100000:2.0:1787834231.092096:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382041984 00000100:00100000:2.0:1787834231.092152:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:2.0:1787834231.092162:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:18688:x1874679382041984:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787834231.092238:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:18688:x1874679382041984:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834231.092245:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1787834231.094244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.094315:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382042240 00000100:00100000:3.0:1787834231.094323:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382042240 00000100:00100000:3.0:1787834231.094374:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787834231.094383:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:18688:x1874679382042240:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787834231.094400:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834231.094419:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f274 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f1dc expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.094491:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.094522:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.094535:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.094549:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.094556:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.094561:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.094798:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1f289 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.094808:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1f289 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.094815:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1f289 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834231.094825:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787834231.095019:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095035:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095042:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095054:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.095058:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095065:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095078:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8df634802900) 00010000:00010000:3.0:1787834231.095080:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.095085:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095090:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f27b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095107:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095113:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095118:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095123:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.095125:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095131:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095150:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8df606324700) 00010000:00010000:3.0:1787834231.095154:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.095157:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.095163:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f282 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.096739:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f274 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1dc expref: 10 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.096785:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723c00/0x996d2fb20dc1f289 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1dc expref: 9 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.096793:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df606324e00) 00010000:00010000:3.0:1787834231.096796:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.096799:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723c00, rc 0) 00000100:00100000:3.0:1787834231.096884:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:18688:x1874679382042240:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 2495us (2639us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787834231.096893:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787834231.107190:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834231.107272:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382042368 00000100:00100000:0.0:1787834231.107282:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382042368 00000100:00100000:0.0:1787834231.107342:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:0.0:1787834231.107352:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:18688:x1874679382042368:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787834231.107452:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:18688:x1874679382042368:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 101us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834231.107459:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:3.0:1787834231.108959:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834231.110004:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382042496 00000100:00100000:0.0:1787834231.110014:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382042496 00000100:00100000:0.0:1787834231.110111:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:0.0:1787834231.110122:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:18688:x1874679382042496:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787834231.110217:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787834231.113723:0:22706:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3564us 00000100:00100000:0.0:1787834231.124875:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:18688:x1874679382042496:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 14745us (15992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834231.124889:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:0.0:1787834231.152000:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.152159:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382042624 00000100:00100000:3.0:1787834231.152168:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382042624 00000100:00100000:3.0:1787834231.152221:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:3.0:1787834231.152229:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:18694:x1874679382042624:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787834231.152247:0:23763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834231.152284:0:23763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f297 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f1e3 expref: -99 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152347:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152361:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152374:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152388:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152395:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152402:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152446:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152454:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152461:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152467:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.152471:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152488:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152500:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0b9c00) 00010000:00010000:3.0:1787834231.152503:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.152507:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152514:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f29e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152543:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152549:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152555:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152560:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.152563:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152568:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152575:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8df606324700) 00010000:00010000:3.0:1787834231.152578:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.152581:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152597:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152787:0:23763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f297 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1e3 expref: 10 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152798:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0b9c00) 00010000:00010000:3.0:1787834231.152800:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.152804:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f297 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1e3 expref: 10 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.152815:0:23763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722a00, rc 0) 00000100:00100000:3.0:1787834231.152872:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:18694:x1874679382042624:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 645us (881us total) trans 0 rc 301/301 00000100:00100000:3.0:1787834231.152880:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1787834231.160434:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.160484:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382042752 00000100:00100000:3.0:1787834231.160493:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382042752 00000100:00100000:3.0:1787834231.160535:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1787834231.160541:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:18694:x1874679382042752:12345-192.168.203.17@tcp:700:lfs.0 00000100:00100000:3.0:1787834231.160632:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:18694:x1874679382042752:12345-192.168.203.17@tcp:700:lfs.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.160639:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1787834231.168335:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.168444:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382043008 00000100:00100000:3.0:1787834231.168454:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382043008 00000100:00100000:3.0:1787834231.168516:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:3.0:1787834231.168527:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:18694:x1874679382043008:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:3.0:1787834231.168603:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834231.168628:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1f20b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f15e expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.168648:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0b9c00) 00010000:00010000:3.0:1787834231.168653:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787834231.168710:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.168724:0:22705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ce expref: 5 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.168734:0:22705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.168831:0:22705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ce expref: 5 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.168845:0:22705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ce expref: 5 pid: 23763 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834231.168860:0:22705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22705:1874679406266368:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787834231.168945:0:22705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787834231.171378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.171469:0:22705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22705:1874679406266368:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787834231.171494:0:22705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834231.171567:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382043136 00000100:00100000:1.0:1787834231.171573:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382043136 00010000:00010000:1.0:1787834231.171672:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ce expref: 6 pid: 23763 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834231.171705:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:1.0:1787834231.171714:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13c826df-92c7-455c-8f83-bbbfe462702e+6:2400:x1874679382043136:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834231.171727:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834231.171733:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ce expref: 6 pid: 23763 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.171745:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ce expref: 6 pid: 23763 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.171818:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f24a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ce expref: 6 pid: 23763 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.171841:0:22690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0b9c00) 00010000:00010000:1.0:1787834231.171846:0:22690:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.171854:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.171860:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.171880:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834231.171923:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13c826df-92c7-455c-8f83-bbbfe462702e+5:2400:x1874679382043136:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 210us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.171931:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00010000:00010000:3.0:1787834231.172103:0:22705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787834231.172168:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787834231.172173:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.172198:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.172208:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.172216:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174281:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174300:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174311:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787834231.174327:0:22705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ab9ce24 reply state 00000000362f3f57 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174338:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174346:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:3.0:1787834231.174348:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787834231.174351:0:22705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787834231.174356:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787834231.174370:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174377:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174384:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174389:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.174393:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174400:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174410:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df63c0b9c00) 00010000:00010000:3.0:1787834231.174413:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.174417:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174423:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787834231.174448:0:22705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ab9ce24 reply state 00000000362f3f57 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174456:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.174462:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8df606324700) 00010000:00010000:3.0:1787834231.174464:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787834231.174472:0:22705:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787834231.174557:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+10:18694:x1874679382043008:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 6029us (6228us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787834231.174566:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:0.0:1787834231.238195:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834231.238293:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382043264 00000100:00100000:2.0:1787834231.238304:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382043264 00000100:00100000:2.0:1787834231.238413:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:2.0:1787834231.238424:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+10:18702:x1874679382043264:12345-192.168.203.17@tcp:101:lctl.0 00010000:00010000:2.0:1787834231.238459:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834231.238480:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1f2c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f1ea expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.238543:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f2c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.238557:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.238568:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834231.238607:0:22704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787834231.238611:0:22704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834231.238646:0:22704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.238682:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1f2c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ea expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.238700:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e800/0x996d2fb20dc1f2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ea expref: 11 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.238709:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:2.0:1787834231.238712:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787834231.238715:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e800, rc 0) 00000100:00100000:2.0:1787834231.238824:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+11:18702:x1874679382043264:12345-192.168.203.17@tcp:101:lctl.0 Request processed in 402us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834231.238832:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:2.0:1787834231.288313:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834231.292888:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382043392 00000100:00100000:0.0:1787834231.292903:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382043392 00000100:00100000:0.0:1787834231.292982:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:0.0:1787834231.292997:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+5:18703:x1874679382043392:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1787834231.293017:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834231.293052:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f2cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f1f1 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.293280:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1f2d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.293294:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1f2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.293306:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1f2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787834231.293347:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787834231.293351:0:22706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787834231.293383:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1f2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.293405:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f2cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1f1 expref: 7 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.293423:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246200/0x996d2fb20dc1f2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1f1 expref: 6 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.293431:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:0.0:1787834231.293434:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787834231.293437:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246200, rc 0) 00000100:00100000:0.0:1787834231.293504:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13c826df-92c7-455c-8f83-bbbfe462702e+6:18703:x1874679382043392:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 510us (5201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834231.293511:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:1.0:1787834231.302961:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.308583:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382043520 00000100:00100000:3.0:1787834231.308597:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382043520 00000100:00100000:3.0:1787834231.308671:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:3.0:1787834231.308683:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13c826df-92c7-455c-8f83-bbbfe462702e+6:18703:x1874679382043520:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787834231.308704:0:23763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834231.308726:0:23763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f1f8 expref: -99 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.308808:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.308824:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.308836:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.308847:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.308855:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.308862:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311506:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1f2f2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311543:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1f2f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311554:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1f2f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834231.311596:0:23763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787834231.311601:0:23763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787834231.311621:0:23763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1f2f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311634:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311642:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311648:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311654:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.311658:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311666:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311678:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:3.0:1787834231.311681:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.311685:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311702:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f2e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311727:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311733:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311739:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311744:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.311747:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311778:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311786:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8df606324700) 00010000:00010000:3.0:1787834231.311789:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.311792:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311798:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f2eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311837:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1f8 expref: 8 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.311865:0:23763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1f2f2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1f8 expref: 7 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.312208:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:3.0:1787834231.312212:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787834231.312216:0:23763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722e00, rc 0) 00000100:00100000:3.0:1787834231.312281:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13c826df-92c7-455c-8f83-bbbfe462702e+7:18703:x1874679382043520:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 3599us (9326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.312289:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:2.0:1787834231.327077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.328430:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382043648 00000100:00100000:3.0:1787834231.328441:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382043648 00000100:00100000:3.0:1787834231.328513:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1787834231.328524:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:13c826df-92c7-455c-8f83-bbbfe462702e+5:18703:x1874679382043648:12345-192.168.203.17@tcp:900:lfs.0 00000100:00100000:3.0:1787834231.328605:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:13c826df-92c7-455c-8f83-bbbfe462702e+5:18703:x1874679382043648:12345-192.168.203.17@tcp:900:lfs.0 Request processed in 84us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.328613:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00080000:2.0:1787834231.329726:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787834231.344111:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.344270:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382043904 00000100:00100000:3.0:1787834231.344279:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382043904 00000100:00100000:3.0:1787834231.344337:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:3.0:1787834231.344347:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df636ad6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13c826df-92c7-455c-8f83-bbbfe462702e+7:18703:x1874679382043904:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787834231.344367:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834231.344385:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f1ff expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834231.344477:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787834231.344584:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ff expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.344598:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:3.0:1787834231.344601:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787834231.344606:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f2f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1ff expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.344629:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722a00, rc 0) 00000100:00100000:3.0:1787834231.344698:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df636ad6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13c826df-92c7-455c-8f83-bbbfe462702e+8:18703:x1874679382043904:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 353us (596us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1787834231.344705:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:0.0:1787834231.356502:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834231.356637:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382044160 00000100:00100000:2.0:1787834231.356647:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382044160 00000100:00100000:2.0:1787834231.356705:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:2.0:1787834231.356716:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+8:18703:x1874679382044160:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:2.0:1787834231.356801:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834231.356828:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722e00/0x996d2fb20dc1f2f2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f1f8 expref: 8 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.356856:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:2.0:1787834231.356862:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787834231.356883:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.356897:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.356907:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787834231.357131:0:22704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c105819e reply state 000000007e9917c0 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.357145:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.357152:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:2.0:1787834231.357169:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1787834231.357172:0:22704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787834231.357180:0:22704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787834231.357266:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+9:18703:x1874679382044160:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 551us (771us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1787834231.357273:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:2.0:1787834231.369954:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834231.370234:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382044416 00000100:00100000:1.0:1787834231.370245:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382044416 00000100:00100000:1.0:1787834231.370305:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:1.0:1787834231.370315:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13c826df-92c7-455c-8f83-bbbfe462702e+9:18703:x1874679382044416:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787834231.370540:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13c826df-92c7-455c-8f83-bbbfe462702e+10:18703:x1874679382044416:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 226us (595us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787834231.370548:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:0.0:1787834231.373347:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.374125:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382044672 00000100:00100000:3.0:1787834231.374135:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382044672 00000100:00100000:3.0:1787834231.374190:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:3.0:1787834231.374198:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13c826df-92c7-455c-8f83-bbbfe462702e+10:18703:x1874679382044672:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787834231.374219:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834231.374239:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f30e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f206 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374307:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374321:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374332:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374364:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374372:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374378:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834231.374468:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787834231.374530:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374538:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374544:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374550:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.374554:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374562:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374574:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:3.0:1787834231.374577:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.374581:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374597:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f315 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374622:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374628:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374634:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374639:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.374642:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374648:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374655:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8df606324700) 00010000:00010000:3.0:1787834231.374658:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.374662:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374668:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f31c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374706:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f30e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f206 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374729:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:3.0:1787834231.374731:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787834231.374735:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f30e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f206 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.374746:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722a00, rc 0) 00000100:00100000:2.0:1787834231.375328:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13c826df-92c7-455c-8f83-bbbfe462702e+11:18703:x1874679382044672:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1127us (1985us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1787834231.375337:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:2.0:1787834231.380799:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.380981:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382044800 00000100:00100000:3.0:1787834231.380990:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382044800 00000100:00100000:3.0:1787834231.381058:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:3.0:1787834231.381070:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+11:18703:x1874679382044800:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787834231.381092:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834231.381112:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f32a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f20d expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.381223:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.381238:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.381250:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834231.381273:0:22704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787834231.381277:0:22704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787834231.381295:0:22704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.381332:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f32a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f20d expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.381350:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f20d expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.381357:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:3.0:1787834231.381360:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787834231.381363:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723400, rc 0) 00000100:00100000:3.0:1787834231.381420:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50250b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13c826df-92c7-455c-8f83-bbbfe462702e+12:18703:x1874679382044800:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 354us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.381427:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:3.0:1787834231.386612:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834231.386700:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382044928 00000100:00100000:1.0:1787834231.386710:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382044928 00000100:00100000:1.0:1787834231.386798:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:1.0:1787834231.386808:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13c826df-92c7-455c-8f83-bbbfe462702e+12:18703:x1874679382044928:12345-192.168.203.17@tcp:37:lfs.0 00000100:00100000:1.0:1787834231.393127:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13c826df-92c7-455c-8f83-bbbfe462702e+12:18703:x1874679382044928:12345-192.168.203.17@tcp:37:lfs.0 Request processed in 6310us (6513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.393141:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1787834231.401416:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834231.401501:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382045184 00000100:00100000:0.0:1787834231.401510:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382045184 00000100:00100000:0.0:1787834231.401561:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:0.0:1787834231.401569:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50447c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13c826df-92c7-455c-8f83-bbbfe462702e+12:18703:x1874679382045184:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1787834231.401792:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50447c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13c826df-92c7-455c-8f83-bbbfe462702e+13:18703:x1874679382045184:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 223us (384us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787834231.401799:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1787834231.415402:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834231.415492:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382045312 00000100:00100000:1.0:1787834231.415500:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382045312 00000100:00100000:1.0:1787834231.415550:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 147 00000100:00100000:1.0:1787834231.415558:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+11:18065:x1874679382045312:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834231.415572:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834231.415588:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030200/0x996d2fb20dc1f338 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f214 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.415613:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030200/0x996d2fb20dc1f338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f214 expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.415625:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030200/0x996d2fb20dc1f338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f214 expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.415634:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030200, rc 0) 00000100:00100000:1.0:1787834231.415688:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18065:x1874679382045312:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 131us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.415695:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 147 00000100:00100000:2.0:1787834231.420235:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.420332:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382045440 00000100:00100000:3.0:1787834231.420340:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382045440 00000100:00100000:3.0:1787834231.420392:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 148 00000100:00100000:3.0:1787834231.420402:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18065:x1874679382045440:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834231.420552:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18065:x1874679382045440:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 151us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.420560:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 148 00000100:00100000:0.0:1787834231.439022:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834231.445017:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382045568 00000100:00100000:2.0:1787834231.445042:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382045568 00000100:00100000:2.0:1787834231.445115:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 149 00000100:00100000:2.0:1787834231.445127:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18065:x1874679382045568:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787834231.445287:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18065:x1874679382045568:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 161us (6271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834231.445295:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 149 00000100:00100000:2.0:1787834231.455849:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834231.455947:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382045696 00000100:00100000:1.0:1787834231.455958:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382045696 00000100:00100000:1.0:1787834231.456013:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 150 00000100:00100000:1.0:1787834231.456023:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+12:18065:x1874679382045696:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834231.456072:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834231.456089:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600030600/0x996d2fb20dc1f33f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f21b expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.456118:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600030600/0x996d2fb20dc1f33f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f21b expref: 13 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.456129:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600030600/0x996d2fb20dc1f33f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f21b expref: 13 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.456138:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030600, rc 0) 00000100:00100000:1.0:1787834231.456198:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18065:x1874679382045696:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 176us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.456204:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 150 00000100:00100000:3.0:1787834231.458113:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834231.458246:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382045824 00000100:00100000:1.0:1787834231.458254:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382045824 00000100:00100000:1.0:1787834231.458304:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 151 00000100:00100000:1.0:1787834231.458313:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18065:x1874679382045824:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787834231.458445:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18065:x1874679382045824:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 133us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.458453:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 151 00000100:00100000:0.0:1787834231.473212:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.473564:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382045952 00000100:00100000:3.0:1787834231.473574:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382045952 00000100:00100000:3.0:1787834231.474779:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:3.0:1787834231.474792:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+11:18710:x1874679382045952:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787834231.474827:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834231.474846:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f346 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f222 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.474969:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.474984:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.474995:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475006:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475013:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475019:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475112:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f35b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475122:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f35b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475130:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f35b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834231.475162:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787834231.475171:0:22706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787834231.475211:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f35b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475223:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475230:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475237:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475243:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.475247:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475254:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475266:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:3.0:1787834231.475269:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.475274:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475280:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f34d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475301:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475307:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475323:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475328:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.475331:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475338:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475346:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8df606324700) 00010000:00010000:3.0:1787834231.475349:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.475352:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475358:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f354 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475385:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f346 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f222 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475403:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723600/0x996d2fb20dc1f35b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f222 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.475410:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:3.0:1787834231.475413:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787834231.475415:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620723600, rc 0) 00000100:00100000:3.0:1787834231.475604:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+12:18710:x1874679382045952:12345-192.168.203.17@tcp:101:bash.0 Request processed in 814us (2401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.475621:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:2.0:1787834231.476253:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834231.476515:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382046080 00000100:00100000:1.0:1787834231.476522:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382046080 00000100:00100000:1.0:1787834231.476561:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 152 00000100:00100000:1.0:1787834231.476569:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18065:x1874679382046080:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787834231.476667:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:18065:x1874679382046080:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 98us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.476679:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 152 00000100:00100000:0.0:1787834231.479081:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.479183:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382046208 00000100:00100000:3.0:1787834231.479191:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382046208 00000100:00100000:3.0:1787834231.479241:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:3.0:1787834231.479251:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:18710:x1874679382046208:12345-192.168.203.17@tcp:900:bash.0 00000100:00100000:3.0:1787834231.479319:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:18710:x1874679382046208:12345-192.168.203.17@tcp:900:bash.0 Request processed in 70us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.479327:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1787834231.490860:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.491000:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382046464 00000100:00100000:3.0:1787834231.491009:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382046464 00000100:00100000:3.0:1787834231.491164:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:3.0:1787834231.491175:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+12:18710:x1874679382046464:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787834231.491196:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834231.491216:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f362 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f229 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.491308:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.491323:0:22704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f20d expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.491332:0:22704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.491363:0:22704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f20d expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.491388:0:22704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f20d expref: 12 pid: 22704 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834231.491401:0:22704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1874679406266496:192.168.203.17@tcp:104: 00000100:00100000:3.0:1787834231.491480:0:22704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c346c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787834231.494620:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834231.494787:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382046592 00000100:00100000:0.0:1787834231.494795:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382046592 00010000:00010000:0.0:1787834231.494829:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f20d expref: 13 pid: 22704 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834231.494865:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:0.0:1787834231.494885:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13c826df-92c7-455c-8f83-bbbfe462702e+13:2401:x1874679382046592:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834231.494899:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834231.494906:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f20d expref: 13 pid: 22704 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.494919:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f20d expref: 13 pid: 22704 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.494942:0:22691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:0.0:1787834231.494947:0:22691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.494956:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.494964:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.494983:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834231.495043:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13c826df-92c7-455c-8f83-bbbfe462702e+13:2401:x1874679382046592:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 169us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834231.495051:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00010000:00010000:3.0:1787834231.496234:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f331 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f20d expref: 12 pid: 22704 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834231.496262:0:22704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1874679406266496:192.168.203.17@tcp:104: 00010000:00010000:3.0:1787834231.496283:0:22704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.496293:0:22704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.496299:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.496520:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.496532:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.496562:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497235:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497257:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497266:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834231.497277:0:22704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787834231.497302:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497309:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497315:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497321:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.497326:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497333:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497344:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:3.0:1787834231.497347:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834231.497352:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497358:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f369 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787834231.497378:0:22704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000219e6436 reply state 0000000020b09d24 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497396:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497402:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8df606324d00) 00010000:00010000:3.0:1787834231.497405:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787834231.497408:0:22704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787834231.497439:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f362 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f229 expref: 15 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497454:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f229 expref: 14 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.497461:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834231.497463:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787834231.497466:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722000, rc 0) 00000100:00100000:3.0:1787834231.497525:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+15:18710:x1874679382046464:12345-192.168.203.17@tcp:101:bash.0 Request processed in 6352us (6673us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787834231.497532:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 37 00000040:00080000:2.0:1787834231.510853:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787834231.512083:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834231.512156:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382046720 00000100:00100000:0.0:1787834231.512179:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382046720 00000100:00100000:0.0:1787834231.512233:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:0.0:1787834231.512242:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+15:18710:x1874679382046720:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1787834231.512265:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834231.512284:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246e00/0x996d2fb20dc1f385 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f230 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.512348:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f38c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.512363:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f38c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.512374:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f38c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787834231.512419:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787834231.512424:0:22705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787834231.512446:0:22705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f38c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.512458:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f38c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.512483:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246e00/0x996d2fb20dc1f385 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f230 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.512501:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f38c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f230 expref: 16 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.512510:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:0.0:1787834231.512518:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787834231.512522:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246c00, rc 0) 00000100:00100000:0.0:1787834231.512584:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+16:18710:x1874679382046720:12345-192.168.203.17@tcp:101:bash.0 Request processed in 343us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834231.512654:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:0.0:1787834231.516244:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834231.516315:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382046976 00000100:00100000:1.0:1787834231.516324:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382046976 00000100:00100000:1.0:1787834231.516380:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:1.0:1787834231.516390:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+16:18710:x1874679382046976:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:1.0:1787834231.516661:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+17:18710:x1874679382046976:12345-192.168.203.17@tcp:35:bash.0 Request processed in 272us (424us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1787834231.516669:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:1.0:1787834231.586091:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.586219:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382047232 00000100:00100000:3.0:1787834231.586227:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382047232 00000100:00100000:3.0:1787834231.586290:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:3.0:1787834231.586300:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+17:18721:x1874679382047232:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787834231.586322:0:23763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834231.586340:0:23763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f237 expref: -99 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834231.586428:0:23763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787834231.586528:0:23763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f393 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f237 expref: 19 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.586541:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:3.0:1787834231.586544:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787834231.586549:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f237 expref: 19 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.586571:0:23763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722800, rc 0) 00000100:00100000:3.0:1787834231.586640:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+18:18721:x1874679382047232:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 340us (557us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1787834231.586647:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:2.0:1787834231.589397:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834231.589675:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382047488 00000100:00100000:1.0:1787834231.589685:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382047488 00000100:00100000:1.0:1787834231.589853:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:1.0:1787834231.589864:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+18:18721:x1874679382047488:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787834231.590220:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+19:18721:x1874679382047488:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 358us (831us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787834231.590229:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:0.0:1787834231.624904:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834231.625048:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382047744 00000100:00100000:2.0:1787834231.625070:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382047744 00000100:00100000:2.0:1787834231.625130:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:2.0:1787834231.625140:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+19:18724:x1874679382047744:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1787834231.625163:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834231.625183:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1f3a1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f23e expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.625284:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f3a8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.625297:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f3a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.625307:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f3a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834231.625316:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787834231.625412:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e400/0x996d2fb20dc1f3a1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f23e expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.625430:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f3a8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f23e expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.625439:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:2.0:1787834231.625442:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787834231.625445:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4fc00, rc 0) 00000100:00100000:2.0:1787834231.625508:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+21:18724:x1874679382047744:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 370us (614us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1787834231.625516:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:2.0:1787834231.629257:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834231.629343:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382047872 00000100:00100000:1.0:1787834231.629353:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382047872 00000100:00100000:1.0:1787834231.629444:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1787834231.629455:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+21:2400:x1874679382047872:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834231.629469:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834231.629493:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4fc00/0x996d2fb20dc1f3a8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f23e expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.629511:0:22690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834231.629528:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834231.629582:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+20:2400:x1874679382047872:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 129us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.629598:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:0.0:1787834231.633342:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834231.633427:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382048000 00000100:00100000:3.0:1787834231.633436:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382048000 00000100:00100000:3.0:1787834231.633533:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:3.0:1787834231.633543:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+20:18724:x1874679382048000:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:3.0:1787834231.633621:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.633638:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.633650:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.633681:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.633687:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.633706:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.633713:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834231.633717:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.633725:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.633736:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834231.633739:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787834231.633744:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834231.633782:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f3b6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834231.633862:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+20:18724:x1874679382048000:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 320us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.633869:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:2.0:1787834231.636528:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834231.636614:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382048256 00000100:00100000:0.0:1787834231.636622:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382048256 00000100:00100000:0.0:1787834231.636674:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1787834231.636683:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+20:18724:x1874679382048256:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1787834231.636918:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+21:18724:x1874679382048256:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 236us (397us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1787834231.636925:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:1.0:1787834231.637930:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406266624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787834231.638002:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787834231.638167:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406266624 00000100:00100000:3.0:1787834231.638173:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406266624 00000100:00100000:3.0:1787834231.638210:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787834231.638217:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406266624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787834231.638240:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787834231.638279:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874679406266624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.638285:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787834231.638333:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874679406266624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787834231.638490:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406266752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834231.638517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834231.638580:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406266752 00000100:00100000:1.0:1787834231.638585:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406266752 00000100:00100000:1.0:1787834231.638626:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787834231.638638:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406266752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787834231.638654:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787834231.638688:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406266752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.638694:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787834231.638720:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406266752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834231.638948:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406266880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787834231.639006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834231.639157:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406266880 00000100:00100000:0.0:1787834231.639161:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406266880 00000100:00100000:0.0:1787834231.639203:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787834231.639209:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406266880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787834231.639227:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787834231.639258:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874679406266880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834231.639276:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787834231.639304:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874679406266880:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787834231.639404:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1787834231.765995:0:22703:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787834231.766002:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df503fe1800 from 13 10000000:01000000:0.0:1787834231.766007:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787834231.766110:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1f3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.766121:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1f3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.766131:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1f3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834231.766154:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.766218:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834231.766261:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27d80 going to sleep for 11 seconds 00000040:00080000:3.0:1787834231.766471:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787834231.766577:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406267008 00000100:00100000:2.0:1787834231.766584:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406267008 00000100:00100000:2.0:1787834231.766639:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787834231.766647:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+20:22703:x1874679406267008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834231.766660:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834231.766671:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1f3c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1f3bd expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.766693:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1f3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1f3bd expref: 21 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.766704:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4fe00/0x996d2fb20dc1f3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1f3bd expref: 21 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.766712:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4fe00, rc 0) 00000100:00100000:2.0:1787834231.766775:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:22703:x1874679406267008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834231.766782:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787834231.766799:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834231.766822:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1f3bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3c4 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.766831:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1f3bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1f3c4 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834231.766899:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.766927:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834231.766952:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787834231.767137:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406267136 00000100:00100000:3.0:1787834231.767142:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406267136 00000100:00100000:3.0:1787834231.767173:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787834231.767181:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+21:22703:x1874679406267136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787834231.767323:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+21:22703:x1874679406267136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834231.767330:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787834231.767351:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.767378:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.767413:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834231.767432:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787834231.767672:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406267264 00000100:00100000:1.0:1787834231.767676:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406267264 00000100:00100000:1.0:1787834231.767708:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787834231.767715:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:22703:x1874679406267264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787834231.767828:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+21:22703:x1874679406267264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.767834:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787834231.768007:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787834231.772847:0:25747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787834231.773708:0:22703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787834231.773734:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787834231.773746:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1f3bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3c4 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.773791:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b247a00/0x996d2fb20dc1f3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3c4 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787834231.773801:0:22703:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787834231.773803:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df6071e9800 from 13 10000000:01000000:0.0:1787834231.773806:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787834231.773842:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246e00/0x996d2fb20dc1f3cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.773850:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df63b246e00/0x996d2fb20dc1f3cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.773860:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df63b246e00/0x996d2fb20dc1f3cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834231.773885:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.773946:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834231.773992:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787834231.774102:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406267392 00000100:00100000:2.0:1787834231.774109:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406267392 00000100:00100000:2.0:1787834231.774158:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787834231.774167:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+21:22703:x1874679406267392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834231.774193:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834231.774206:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1f3d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1f3cb expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.774229:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1f3d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1f3cb expref: 22 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.774240:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df611a4e400/0x996d2fb20dc1f3d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1f3cb expref: 22 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.774248:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df611a4e400, rc 0) 00000100:00100000:2.0:1787834231.774300:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+22:22703:x1874679406267392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834231.774307:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787834231.774428:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834231.774441:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df63b246e00/0x996d2fb20dc1f3cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3d2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.774450:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df63b246e00/0x996d2fb20dc1f3cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1f3d2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834231.774511:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.774543:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834231.775703:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787834231.776138:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406267520 00000100:00100000:1.0:1787834231.776145:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406267520 00000100:00100000:1.0:1787834231.776193:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787834231.776202:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+22:22703:x1874679406267520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787834231.776342:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9903e54-1448-45ce-bd63-f50f2c84e331+22:22703:x1874679406267520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.776349:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787834231.776577:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.776626:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.776669:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834231.776739:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787834231.776852:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406267648 00000100:00100000:1.0:1787834231.776856:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406267648 00000100:00100000:1.0:1787834231.776945:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787834231.776953:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+22:22703:x1874679406267648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787834231.777045:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+22:22703:x1874679406267648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.777052:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787834231.777131:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787834231.778948:0:25748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787834231.779280:0:22703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787834231.779302:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787834231.779312:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df63b246e00/0x996d2fb20dc1f3cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3d2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.779323:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df63b246e00/0x996d2fb20dc1f3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3d2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834231.779334:0:22703:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787834231.779337:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df503c53800 from 13 10000000:01000000:2.0:1787834231.779340:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787834231.779373:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fc00/0x996d2fb20dc1f3d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.779380:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4fc00/0x996d2fb20dc1f3d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.779402:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4fc00/0x996d2fb20dc1f3d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834231.779422:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787834231.779477:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834231.779557:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60ec0e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787834231.779665:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406267776 00000100:00100000:1.0:1787834231.779672:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406267776 00000100:00100000:1.0:1787834231.779745:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787834231.779779:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+22:22703:x1874679406267776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834231.779791:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834231.779803:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600031400/0x996d2fb20dc1f3e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1f3d9 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.779826:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031400/0x996d2fb20dc1f3e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1f3d9 expref: 23 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.779837:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600031400/0x996d2fb20dc1f3e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1f3d9 expref: 23 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.779845:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031400, rc 0) 00000100:00100000:1.0:1787834231.779897:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406267776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.779913:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787834231.779991:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787834231.780005:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4fc00/0x996d2fb20dc1f3d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3e0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.780014:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4fc00/0x996d2fb20dc1f3d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1f3e0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834231.780075:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.780104:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834231.780323:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787834231.780378:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406267904 00000100:00100000:2.0:1787834231.780382:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406267904 00000100:00100000:2.0:1787834231.780406:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787834231.780412:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406267904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787834231.780569:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406267904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834231.780577:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787834231.780677:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406267904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.780706:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406268032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.780747:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834231.780796:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787834231.780853:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406268032 00000100:00100000:2.0:1787834231.780857:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406268032 00000100:00100000:2.0:1787834231.780943:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787834231.780951:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406268032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787834231.781041:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406268032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834231.781048:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787834231.781144:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406268032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787834231.782096:0:25749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787834231.782256:0:22703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787834231.782277:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787834231.782286:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4fc00/0x996d2fb20dc1f3d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3e0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.782296:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4fc00/0x996d2fb20dc1f3d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3e0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787834231.782314:0:22703:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787834231.782317:0:22703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8df60ed4e000 from 13 10000000:01000000:2.0:1787834231.782319:0:22703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787834231.782345:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1f3e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.782351:0:22703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1f3e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.782359:0:22703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1f3e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834231.782374:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406268160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787834231.782411:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834231.782451:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60eaca540 going to sleep for 11 seconds 00000100:00100000:1.0:1787834231.782517:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406268160 00000100:00100000:1.0:1787834231.782523:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406268160 00000100:00100000:1.0:1787834231.782554:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787834231.782561:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+23:22703:x1874679406268160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787834231.782572:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834231.782698:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8df600031600/0x996d2fb20dc1f3ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x996d2fb20dc1f3e7 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.782722:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8df600031600/0x996d2fb20dc1f3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x996d2fb20dc1f3e7 expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.782732:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8df600031600/0x996d2fb20dc1f3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x996d2fb20dc1f3e7 expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834231.782739:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031600, rc 0) 00000100:00100000:1.0:1787834231.782797:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:22703:x1874679406268160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.782803:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787834231.782949:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406268160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787834231.782962:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1f3e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3ee expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.782970:0:22703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1f3e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x996d2fb20dc1f3ee expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834231.783018:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406268288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787834231.783168:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834231.783196:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60eaca540 going to sleep for 11 seconds 00000100:00100000:0.0:1787834231.783264:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406268288 00000100:00100000:0.0:1787834231.783268:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406268288 00000100:00100000:0.0:1787834231.783291:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787834231.783297:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:22703:x1874679406268288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787834231.783392:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9903e54-1448-45ce-bd63-f50f2c84e331+24:22703:x1874679406268288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834231.783400:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787834231.783468:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406268288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787834231.783494:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406268416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787834231.783534:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834231.783555:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60eaca540 going to sleep for 11 seconds 00000100:00100000:1.0:1787834231.783669:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406268416 00000100:00100000:1.0:1787834231.783674:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406268416 00000100:00100000:1.0:1787834231.783692:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787834231.783698:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df62699a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:22703:x1874679406268416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787834231.783802:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df62699a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:22703:x1874679406268416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834231.783810:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787834231.784004:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9903e54-1448-45ce-bd63-f50f2c84e331:22703:1874679406268416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787834231.785266:0:25750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787834231.785486:0:22703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787834231.785510:0:22703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787834231.785518:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1f3e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3ee expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.785529:0:22703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffff8df611a4f000/0x996d2fb20dc1f3e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x996d2fb20dc1f3ee expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834231.939825:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834231.939979:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382048512 00000100:00100000:2.0:1787834231.939988:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382048512 00000100:00100000:2.0:1787834231.940057:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:2.0:1787834231.940068:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+21:18755:x1874679382048512:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:2.0:1787834231.940100:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834231.940120:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1f3f5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f245 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.940223:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f3fc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.940238:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f3fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.940250:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f3fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834231.940260:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787834231.940384:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4e600/0x996d2fb20dc1f3f5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f245 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.940401:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f3fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f245 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834231.940409:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:2.0:1787834231.940413:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787834231.940416:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fda00, rc 0) 00000100:00100000:2.0:1787834231.940929:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+23:18755:x1874679382048512:12345-192.168.203.17@tcp:101:cat.0 Request processed in 862us (1112us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1787834231.940937:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:2.0:1787834231.952480:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834231.952525:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834231.952804:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382048640 00000100:00100000:0.0:1787834231.952814:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382048640 00000100:00100000:0.0:1787834231.952884:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:0.0:1787834231.952894:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+23:2401:x1874679382048640:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834231.952910:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834231.952933:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f3fc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f245 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834231.952954:0:22691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:0.0:1787834231.952959:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834231.953006:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+22:2401:x1874679382048640:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 114us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834231.953014:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:1.0:1787834231.954816:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382048896 00000100:00100000:1.0:1787834231.954829:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382048896 00000100:00100000:1.0:1787834231.954902:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:1.0:1787834231.954912:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+22:18755:x1874679382048896:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:1.0:1787834231.955422:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+23:18755:x1874679382048896:12345-192.168.203.17@tcp:35:cat.0 Request processed in 511us (2894us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1787834231.955431:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00010000:00010000:3.0:1787834231.958046:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834232.062838:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834232.062937:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382049152 00000100:00100000:3.0:1787834232.062947:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382049152 00000100:00100000:3.0:1787834232.063003:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:3.0:1787834232.063013:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+23:18761:x1874679382049152:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:3.0:1787834232.063058:0:23763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834232.063080:0:23763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f40a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f24c expref: -99 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.063185:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f411 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.063199:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f411 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.063210:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f411 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834232.063239:0:23763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787834232.063365:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f40a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f24c expref: 26 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.063395:0:23763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f411 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f24c expref: 25 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.063404:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834232.063407:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787834232.063409:0:23763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722200, rc 0) 00000100:00100000:3.0:1787834232.063694:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+25:18761:x1874679382049152:12345-192.168.203.17@tcp:101:dd.0 Request processed in 681us (863us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1787834232.063702:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:2.0:1787834232.067614:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834232.067733:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382049280 00000100:00100000:3.0:1787834232.067743:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382049280 00000100:00100000:3.0:1787834232.067825:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:3.0:1787834232.067835:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+25:18761:x1874679382049280:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:3.0:1787834232.067857:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834232.067886:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f41f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f253 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.067929:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.067943:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.067973:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.068090:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f41f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f253 expref: 27 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.068120:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f253 expref: 26 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.068129:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834232.068132:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787834232.068135:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722a00, rc 0) 00000100:00100000:3.0:1787834232.068192:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+26:18761:x1874679382049280:12345-192.168.203.17@tcp:101:dd.0 Request processed in 358us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.068204:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:1.0:1787834232.078560:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834232.078728:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.078829:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382049664 00000100:00100000:2.0:1787834232.078838:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382049664 00000100:00100000:2.0:1787834232.078917:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:2.0:1787834232.078928:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+26:2400:x1874679382049664:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787834232.078943:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787834232.078970:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722200/0x996d2fb20dc1f411 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f24c expref: 26 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.078998:0:22690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:2.0:1787834232.079003:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834232.079075:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+25:2400:x1874679382049664:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 149us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.079103:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:3.0:1787834232.080321:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382049536 00000100:00100000:3.0:1787834232.080331:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382049536 00000100:00100000:3.0:1787834232.080410:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:3.0:1787834232.080419:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+25:18761:x1874679382049536:12345-192.168.203.17@tcp:36:dd.0 00010000:00010000:3.0:1787834232.080477:0:23763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834232.080499:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f38c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f230 expref: 25 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.080515:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834232.080520:0:23763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787834232.080687:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.080711:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.080721:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787834232.080780:0:23763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1787834232.080810:0:23763:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000842e04da reply state 000000009f2900f9 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.080822:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.080829:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834232.080832:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787834232.080835:0:23763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787834232.080937:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+27:18761:x1874679382049536:12345-192.168.203.17@tcp:36:dd.0 Request processed in 518us (2486us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1787834232.080944:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000020:00080000:3.0:1787834232.080949:0:23763:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787834232.150042:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406268544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787834232.150117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150445:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406268800:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150513:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406269312:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150548:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6376d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406269824:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150596:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787834232.150602:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9903e54-1448-45ce-bd63-f50f2c84e331:3639:1874679406268672:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150652:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406269184:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150684:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6376d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406269696:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150724:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406269056:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150794:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6376d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406269568:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150833:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6376d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406270080:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150852:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150864:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787834232.150870:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406268928:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150907:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df504dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406269440:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150926:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150940:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6376d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406269952:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.150959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834232.150981:0:25150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406269056 00000100:00100000:1.0:1787834232.150988:0:25150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406269056 00000100:00100000:1.0:1787834232.151042:0:25150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406268928 00000100:00100000:1.0:1787834232.151046:0:25150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406268928 00000100:00100000:1.0:1787834232.151064:0:25150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406269440 00000100:00100000:1.0:1787834232.151067:0:25150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406269440 00000100:00100000:1.0:1787834232.151082:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787834232.151090:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406269056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151154:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406269056:12345-0@lo:400:kworker.0 Request processed in 65us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834232.151160:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787834232.151175:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787834232.151180:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406268928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151207:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406268928:12345-0@lo:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834232.151220:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787834232.151232:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787834232.151239:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406269440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151267:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406269440:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834232.151272:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787834232.151299:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406268800 00000100:00100000:1.0:1787834232.151302:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406268800 00000100:00100000:1.0:1787834232.151319:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406269312 00000100:00100000:1.0:1787834232.151322:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406269312 00000100:00100000:1.0:1787834232.151334:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787834232.151339:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406268800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151374:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406268800:12345-0@lo:400:kworker.0 Request processed in 35us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834232.151380:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787834232.151392:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787834232.151398:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406269312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151425:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406269312:12345-0@lo:400:kworker.0 Request processed in 27us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834232.151431:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787834232.151467:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406268800:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151479:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406269312:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151507:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406268928:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151517:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406269440:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151536:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406269056:0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151558:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406268672 00000100:00100000:1.0:1787834232.151561:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406268672 00000100:00100000:1.0:1787834232.151586:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787834232.151592:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3639:x1874679406268672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787834232.151625:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9903e54-1448-45ce-bd63-f50f2c84e331+24:3639:x1874679406268672:12345-0@lo:400:kworker.0 Request processed in 33us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834232.151631:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787834232.151662:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9903e54-1448-45ce-bd63-f50f2c84e331:3639:1874679406268672:0@lo:400:kworker.0 00000100:00080000:3.0:1787834232.152009:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787834232.152014:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787834232.152033:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406269824 00000100:00100000:3.0:1787834232.152037:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406269824 00000100:00100000:3.0:1787834232.152072:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406269184 00000100:00100000:3.0:1787834232.152075:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406269184 00000100:00100000:3.0:1787834232.152085:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406269696 00000100:00100000:3.0:1787834232.152087:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406269696 00000100:00100000:3.0:1787834232.152099:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406269568 00000100:00100000:3.0:1787834232.152102:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406269568 00000100:00100000:3.0:1787834232.152112:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406270080 00000100:00100000:3.0:1787834232.152122:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406270080 00000100:00100000:3.0:1787834232.152142:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406269952 00000100:00100000:3.0:1787834232.152144:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406269952 00000100:00100000:3.0:1787834232.152157:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787834232.152162:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406269824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834232.152201:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874679406269824:12345-0@lo:400:kworker.0 Request processed in 39us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.152207:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787834232.152220:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787834232.152225:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406269184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834232.152250:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874679406269184:12345-0@lo:400:kworker.0 Request processed in 25us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.152255:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787834232.152266:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787834232.152272:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406269696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834232.152297:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874679406269696:12345-0@lo:400:kworker.0 Request processed in 25us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.152302:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787834232.152314:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787834232.152319:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406269568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834232.152364:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874679406269568:12345-0@lo:400:kworker.0 Request processed in 45us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.152371:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787834232.152383:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787834232.152389:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406270080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834232.152416:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874679406270080:12345-0@lo:400:kworker.0 Request processed in 27us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.152427:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787834232.152440:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787834232.152446:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406269952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787834232.153617:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874679406269952:12345-0@lo:400:kworker.0 Request processed in 1168us (2653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.153626:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787834232.153677:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df504dc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874679406269184:0@lo:400:kworker.0 00000100:00100000:3.0:1787834232.153690:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6376d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874679406269696:0@lo:400:kworker.0 00010000:00080000:3.0:1787834232.153703:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6376d4780 x1874679406269824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834232.153713:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6376d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874679406269824:0@lo:400:kworker.0 00000100:00100000:3.0:1787834232.153744:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6376d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1874679406269952:0@lo:400:kworker.0 00000100:00100000:3.0:1787834232.153774:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6376d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874679406269568:0@lo:400:kworker.0 00010000:00080000:3.0:1787834232.153785:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8df6376d4000 x1874679406270080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787834248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787834232.153794:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6376d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874679406270080:0@lo:400:kworker.0 00000100:00100000:2.0:1787834232.153895:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406268544 00000100:00100000:2.0:1787834232.153900:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406268544 00000100:00100000:2.0:1787834232.153948:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787834232.153956:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df504dc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406268544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787834232.153978:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787834232.154019:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df504dc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406268544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.154035:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787834232.154073:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406268544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787834232.154300:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787834232.154312:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406270208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787834232.154349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834232.154390:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406270208 00000100:00100000:0.0:1787834232.154394:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406270208 00000100:00100000:0.0:1787834232.154417:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787834232.154423:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406270208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787834232.154433:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787834232.154477:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406270208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834232.154483:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787834232.154519:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406270208:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787834232.154529:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787834232.154535:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787834232.154538:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787834232.154772:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787834232.157718:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406270336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787834232.157812:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787834232.157907:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406270336 00000100:00100000:0.0:1787834232.157915:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406270336 00000100:00100000:0.0:1787834232.157965:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787834232.157974:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406270336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787834232.157997:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787834232.158060:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874679406270336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834232.158067:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787834232.158155:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874679406270336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787834232.173291:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834232.173411:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382049920 00000100:00100000:0.0:1787834232.173421:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382049920 00000100:00100000:0.0:1787834232.173485:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:0.0:1787834232.173496:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+27:18761:x1874679382049920:12345-192.168.203.17@tcp:35:dd.0 00000100:00100000:0.0:1787834232.176333:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+28:18761:x1874679382049920:12345-192.168.203.17@tcp:35:dd.0 Request processed in 2829us (3042us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1787834232.176347:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:0.0:1787834232.322713:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834232.324416:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382050048 00000100:00100000:3.0:1787834232.324557:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382050048 00000100:00100000:3.0:1787834232.331009:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:3.0:1787834232.331045:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+28:18775:x1874679382050048:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:3.0:1787834232.331096:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834232.331136:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f434 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f25a expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331233:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331247:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331389:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331404:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331411:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331417:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331550:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1f449 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331621:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1f449 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331629:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1f449 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834232.331668:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787834232.331672:0:22706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787834232.331712:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1f449 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331733:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1f449 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331741:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331747:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331775:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331781:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834232.331785:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331792:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331804:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:3.0:1787834232.331807:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834232.331812:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331818:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f43b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331841:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331847:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331858:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331863:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834232.331865:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331872:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331881:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8df606324d00) 00010000:00010000:3.0:1787834232.331883:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834232.331886:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331891:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f442 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331928:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f434 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f25a expref: 30 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331943:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1f449 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f25a expref: 29 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.331950:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834232.331952:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787834232.331955:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722600, rc 0) 00000100:00100000:3.0:1787834232.332039:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+29:18775:x1874679382050048:12345-192.168.203.17@tcp:101:stat.0 Request processed in 1018us (9332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.332054:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:2.0:1787834232.374324:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.374419:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.374457:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.374493:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.374513:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.374534:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.374552:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.374579:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.374601:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382050432 00000100:00100000:2.0:1787834232.374609:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382050432 00000100:00100000:2.0:1787834232.374663:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382050944 00000100:00100000:2.0:1787834232.374666:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382050944 00000100:00100000:2.0:1787834232.374695:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382050560 00000100:00100000:2.0:1787834232.374698:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382050560 00000100:00100000:2.0:1787834232.374725:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382051072 00000100:00100000:2.0:1787834232.374727:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382051072 00000100:00100000:2.0:1787834232.374743:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1787834232.374776:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2398:x1874679382050432:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834232.374840:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2398:x1874679382050432:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 90us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.374847:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1787834232.374862:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1787834232.374879:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13c826df-92c7-455c-8f83-bbbfe462702e+5:2398:x1874679382050944:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834232.374899:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13c826df-92c7-455c-8f83-bbbfe462702e+5:2398:x1874679382050944:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.374915:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1787834232.374926:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:2.0:1787834232.374932:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2398:x1874679382050560:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834232.374950:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2398:x1874679382050560:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 20us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.374955:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:2.0:1787834232.374965:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1787834232.374970:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13c826df-92c7-455c-8f83-bbbfe462702e+5:2398:x1874679382051072:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834232.374986:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13c826df-92c7-455c-8f83-bbbfe462702e+5:2398:x1874679382051072:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 16us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.374992:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00080000:2.0:1787834232.375011:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787834232.375015:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787834232.375177:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382050688 00000100:00100000:2.0:1787834232.375181:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382050688 00000100:00100000:2.0:1787834232.375206:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382050304 00000100:00100000:2.0:1787834232.375209:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382050304 00000100:00100000:2.0:1787834232.375237:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382050816 00000100:00100000:2.0:1787834232.375240:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382050816 00000100:00100000:2.0:1787834232.375254:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:2.0:1787834232.375261:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13c826df-92c7-455c-8f83-bbbfe462702e+12:2398:x1874679382050688:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834232.375310:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13c826df-92c7-455c-8f83-bbbfe462702e+12:2398:x1874679382050688:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 49us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.375316:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:2.0:1787834232.375331:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:2.0:1787834232.375337:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2398:x1874679382050304:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834232.375360:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2398:x1874679382050304:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.375366:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:2.0:1787834232.375377:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:2.0:1787834232.375382:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13c826df-92c7-455c-8f83-bbbfe462702e+5:2398:x1874679382050816:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834232.375403:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13c826df-92c7-455c-8f83-bbbfe462702e+5:2398:x1874679382050816:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 20us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.375408:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:3.0:1787834232.386147:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382050176 00000100:00100000:3.0:1787834232.386163:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382050176 00000100:00100000:2.0:1787834232.387075:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 166 00000100:00100000:2.0:1787834232.387085:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df626998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:2398:x1874679382050176:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1787834232.387172:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df626998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b8888f5-5649-4fae-a1a1-da83a70d41f3+13:2398:x1874679382050176:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 88us (12856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.387196:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 166 00000100:00100000:2.0:1787834232.414039:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834232.414297:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382051328 00000100:00100000:0.0:1787834232.414430:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382051328 00000100:00100000:0.0:1787834232.414527:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:0.0:1787834232.414538:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+29:18781:x1874679382051328:12345-192.168.203.17@tcp:36:truncate.0 00010000:00010000:0.0:1787834232.414591:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834232.414625:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722600/0x996d2fb20dc1f449 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f25a expref: 29 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.414655:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:0.0:1787834232.414660:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787834232.414920:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.414934:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.414943:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787834232.415992:0:22705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1787834232.416044:0:22705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bc99417 reply state 00000000c3862799 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.416249:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.416258:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:0.0:1787834232.416261:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787834232.416264:0:22705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787834232.416524:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+31:18781:x1874679382051328:12345-192.168.203.17@tcp:36:truncate.0 Request processed in 1984us (2544us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1787834232.416533:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00000020:00080000:1.0:1787834232.416539:0:22705:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787834232.604655:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834232.604826:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382051456 00000100:00100000:0.0:1787834232.604836:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382051456 00000100:00100000:0.0:1787834232.604975:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:0.0:1787834232.604995:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+31:18795:x1874679382051456:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:0.0:1787834232.605029:0:23763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834232.605050:0:23763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1f457 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f261 expref: -99 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605128:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605154:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605167:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605179:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605186:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605192:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605294:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605303:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605310:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787834232.605360:0:23763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1787834232.605364:0:23763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787834232.605385:0:23763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605397:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605405:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605411:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605418:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605423:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787834232.605428:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605434:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605457:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:0.0:1787834232.605460:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787834232.605464:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605470:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f45e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605493:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605499:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605504:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605509:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787834232.605512:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605519:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605527:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8df606324d00) 00010000:00010000:0.0:1787834232.605530:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787834232.605533:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605538:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f465 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605561:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1f457 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f261 expref: 33 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605570:0:23763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f261 expref: 32 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.605582:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:0.0:1787834232.605584:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787834232.605586:0:23763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247600, rc 0) 00000100:00100000:0.0:1787834232.605643:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+32:18795:x1874679382051456:12345-192.168.203.17@tcp:101:stat.0 Request processed in 649us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834232.605649:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:2.0:1787834232.698510:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834232.699181:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382051712 00000100:00100000:3.0:1787834232.699193:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382051712 00000100:00100000:3.0:1787834232.699263:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:3.0:1787834232.699274:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+32:18805:x1874679382051712:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1787834232.699298:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834232.699319:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f268 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787834232.699412:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787834232.699515:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f473 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f268 expref: 34 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.699531:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:3.0:1787834232.699534:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787834232.699540:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f268 expref: 34 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.699562:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722800, rc 0) 00000100:00100000:3.0:1787834232.699890:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+33:18805:x1874679382051712:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 617us (1391us total) trans 12884901910 rc 301/301 00000100:00100000:3.0:1787834232.699895:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:3.0:1787834232.702742:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834232.703204:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382051968 00000100:00100000:0.0:1787834232.703214:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382051968 00000100:00100000:0.0:1787834232.703276:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1787834232.703287:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df50447f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+33:18805:x1874679382051968:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1787834232.703998:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df50447f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+34:18805:x1874679382051968:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 709us (1260us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1787834232.704007:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:2.0:1787834232.781935:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834232.782082:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382052224 00000100:00100000:0.0:1787834232.782091:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382052224 00000100:00100000:0.0:1787834232.782148:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:0.0:1787834232.782157:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+34:18811:x1874679382052224:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1787834232.782179:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834232.782199:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1f481 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f26f expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.782300:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.782314:0:22704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f229 expref: 35 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.782336:0:22704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f261 expref: 35 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.782344:0:22704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.782376:0:22704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f261 expref: 35 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.782389:0:22704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f261 expref: 35 pid: 23763 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834232.782403:0:22704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1874679406270464:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787834232.782497:0:22704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f229 expref: 35 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.782506:0:22704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f229 expref: 35 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834232.782514:0:22704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1874679406270592:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787834232.782537:0:22704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787834232.789864:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.789912:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834232.790048:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382052352 00000100:00100000:1.0:1787834232.790067:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382052352 00010000:00010000:1.0:1787834232.790110:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f261 expref: 36 pid: 23763 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834232.790145:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382052480 00000100:00100000:1.0:1787834232.790148:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382052480 00010000:00010000:1.0:1787834232.790161:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f229 expref: 37 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834232.790203:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1787834232.790213:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:2401:x1874679382052352:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834232.790228:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834232.790235:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f261 expref: 37 pid: 23763 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.790248:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f261 expref: 37 pid: 23763 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.790271:0:22692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834232.790277:0:22692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.790286:0:22692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.790292:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834232.790345:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:2401:x1874679382052352:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 133us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834232.790353:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1787834232.790397:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:1.0:1787834232.790404:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+36:2401:x1874679382052480:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834232.790412:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834232.790417:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f229 expref: 36 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.790438:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f229 expref: 36 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.790450:0:22692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834232.790453:0:22692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.790460:0:22692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.790468:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.790487:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787834232.790507:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+36:2401:x1874679382052480:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 103us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834232.790514:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000040:00080000:2.0:1787834232.792144:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787834232.792946:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247600/0x996d2fb20dc1f46c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f261 expref: 35 pid: 23763 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834232.792966:0:22704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1874679406270464:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787834232.792996:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722000/0x996d2fb20dc1f377 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f229 expref: 34 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834232.793030:0:22704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1874679406270592:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787834232.793065:0:22704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.793075:0:22704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.793081:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787834232.793100:0:22704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787834232.793222:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246000/0x996d2fb20dc1f481 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f26f expref: 35 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.793237:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f26f expref: 34 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.793245:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:0.0:1787834232.793248:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787834232.793251:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247e00, rc 0) 00000100:00100000:0.0:1787834232.793316:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+34:18811:x1874679382052224:12345-192.168.203.17@tcp:101:bash.0 Request processed in 11159us (11388us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1787834232.793324:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:2.0:1787834232.797430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834232.797569:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382052736 00000100:00100000:1.0:1787834232.797579:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382052736 00000100:00100000:1.0:1787834232.797639:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:1.0:1787834232.797649:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+34:18811:x1874679382052736:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:1.0:1787834232.798006:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.798034:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.798047:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787834232.798108:0:22705:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1787834232.798134:0:22705:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a6a56ff reply state 0000000015dd11d2 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.798146:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.798154:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834232.798157:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787834232.798161:0:22705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787834232.798252:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:18811:x1874679382052736:12345-192.168.203.17@tcp:36:bash.0 Request processed in 604us (830us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1787834232.798260:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000020:00080000:1.0:1787834232.798265:0:22705:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787834232.801142:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.801422:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382052864 00000100:00100000:2.0:1787834232.801431:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382052864 00000100:00100000:2.0:1787834232.801527:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:2.0:1787834232.801537:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:18811:x1874679382052864:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1787834232.801561:0:23763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834232.801592:0:23763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f49d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f276 expref: -99 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.801656:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f49d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f276 expref: 38 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.801671:0:23763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f49d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f276 expref: 38 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.801689:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:2.0:1787834232.801692:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787834232.801696:0:23763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fdc00, rc 0) 00000100:00100000:2.0:1787834232.801777:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+38:18811:x1874679382052864:12345-192.168.203.17@tcp:101:bash.0 Request processed in 242us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.801795:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:2.0:1787834232.815008:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834232.815162:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382052992 00000100:00100000:1.0:1787834232.815172:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382052992 00000100:00100000:1.0:1787834232.815232:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:1.0:1787834232.815242:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+38:18811:x1874679382052992:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1787834232.815262:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834232.815281:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f4a4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f27d expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.815364:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.815379:0:22705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f26f expref: 39 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.815416:0:22705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.815464:0:22705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f26f expref: 39 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834232.815478:0:22705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f26f expref: 39 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834232.815492:0:22705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6376d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22705:1874679406270720:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787834232.815576:0:22705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e181180 going to sleep for 11 seconds 00000100:00100000:1.0:1787834232.819208:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.819303:0:22705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6376d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22705:1874679406270720:192.168.203.17@tcp:104: 00010000:00010000:2.0:1787834232.819328:0:22705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834232.819389:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382053120 00000100:00100000:3.0:1787834232.819396:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382053120 00010000:00010000:3.0:1787834232.819444:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f26f expref: 40 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834232.819491:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:3.0:1787834232.819500:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+40:2400:x1874679382053120:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787834232.819515:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834232.819523:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f26f expref: 40 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.819535:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f26f expref: 40 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.819560:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247e00/0x996d2fb20dc1f488 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f26f expref: 40 pid: 22704 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.819577:0:22692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834232.819592:0:22692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.819603:0:22692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.819610:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.819637:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834232.819701:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+39:2400:x1874679382053120:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 201us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.819724:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00010000:00010000:2.0:1787834232.820171:0:22705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.820180:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834232.820231:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787834232.820236:0:22705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834232.820259:0:22705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.820291:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f4a4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f27d expref: 39 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.820307:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f27d expref: 38 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.820314:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:2.0:1787834232.820317:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787834232.820319:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030e00, rc 0) 00000100:00100000:2.0:1787834232.820354:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+38:18811:x1874679382052992:12345-192.168.203.17@tcp:101:bash.0 Request processed in 5114us (5355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.820371:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:3.0:1787834232.823166:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834232.824073:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382053376 00000100:00100000:2.0:1787834232.824083:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382053376 00000100:00100000:2.0:1787834232.824178:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1787834232.824188:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+38:18811:x1874679382053376:12345-192.168.203.17@tcp:103:bash.0 00010000:00010000:2.0:1787834232.824203:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787834232.824227:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f49d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f276 expref: 38 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.824249:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f4ab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f27d expref: 37 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834232.824261:0:22690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:2.0:1787834232.824266:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787834232.824319:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+36:18811:x1874679382053376:12345-192.168.203.17@tcp:103:bash.0 Request processed in 133us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834232.824326:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1787834232.826247:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834232.826335:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382053504 00000100:00100000:0.0:1787834232.826341:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382053504 00000100:00100000:0.0:1787834232.826399:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:0.0:1787834232.826408:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+36:18811:x1874679382053504:12345-192.168.203.17@tcp:58:bash.0 00010000:00010000:0.0:1787834232.826520:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.826783:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834232.826796:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787834232.829344:0:22704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787834232.829387:0:22704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1787834232.829550:0:22704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1787834232.829649:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+36:18811:x1874679382053504:12345-192.168.203.17@tcp:58:bash.0 Request processed in 3238us (3404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834232.829660:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:0.0:1787834232.834119:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834232.834195:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382053632 00000100:00100000:3.0:1787834232.834204:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382053632 00000100:00100000:3.0:1787834232.834279:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:3.0:1787834232.834289:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+36:18811:x1874679382053632:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1787834232.834306:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787834232.834324:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f4b9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f284 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.834373:0:22706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.834383:0:22706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f4b9 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f284 expref: 37 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.834407:0:22706:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.834419:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f4b9 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f284 expref: 37 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.834431:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834232.834434:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787834232.834438:0:22706:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f4b9 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f284 expref: 37 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834232.834446:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df620722800, rc 0) 00000100:00100000:3.0:1787834232.834520:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:18811:x1874679382053632:12345-192.168.203.17@tcp:101:bash.0 Request processed in 233us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834232.834527:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00010000:00010000:3.0:1787834232.983031:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787834233.558903:0:22740:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787834233.558912:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787834233.558968:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787834233.558978:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787834233.559144:0:22740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df502ed30c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22740:1874679406270848:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787834233.559245:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787834233.562296:0:22740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df502ed30c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22740:1874679406270848:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787834233.563820:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834233.564490:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382053760 00000100:00100000:2.0:1787834233.564500:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382053760 00000100:00100000:2.0:1787834233.564584:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:2.0:1787834233.564596:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:18813:x1874679382053760:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787834233.564628:0:23763:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787834233.564776:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:18813:x1874679382053760:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 155us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834233.564802:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00080000:1.0:1787834233.566214:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787834233.580209:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834233.580289:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382053888 00000100:00100000:2.0:1787834233.580298:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382053888 00000100:00100000:2.0:1787834233.580355:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:2.0:1787834233.580366:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:18813:x1874679382053888:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787834233.580439:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580455:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580469:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580517:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580526:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580533:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580555:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580565:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580572:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787834233.580629:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787834233.580633:0:22705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787834233.580646:0:22705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580657:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580664:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580671:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580677:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fdc00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834233.580682:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580689:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580702:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df606324e00) 00010000:00010000:2.0:1787834233.580705:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834233.580709:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580715:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fdc00/0x996d2fb20dc1f4c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580729:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580745:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580901:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580906:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fc200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834233.580910:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580916:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580925:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8df634802500) 00010000:00010000:2.0:1787834233.580928:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834233.580931:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580937:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f4c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580954:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580960:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580966:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580971:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fd200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:2.0:1787834233.580981:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580987:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.580996:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:2.0:1787834233.580998:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787834233.581001:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.581007:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f4ce lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834233.581121:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:18813:x1874679382053888:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 755us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834233.581131:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:2.0:1787834233.585972:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.586060:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382054144 00000100:00100000:0.0:1787834233.586068:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382054144 00000100:00100000:0.0:1787834233.586151:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:0.0:1787834233.586177:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+37:18813:x1874679382054144:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787834233.586198:0:23763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834233.586218:0:23763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1f4d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f28b expref: -99 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586320:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586336:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586348:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787834233.586359:0:23763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787834233.586440:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586447:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586454:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586460:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:0.0:1787834233.586465:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586472:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586485:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:0.0:1787834233.586495:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787834233.586500:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586508:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f4dc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586554:0:23763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1f4d5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f28b expref: 39 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586565:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8df606324e00) 00010000:00010000:0.0:1787834233.586567:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787834233.586571:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247200/0x996d2fb20dc1f4d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f28b expref: 39 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.586595:0:23763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b247200, rc 0) 00000100:00100000:0.0:1787834233.586663:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+38:18813:x1874679382054144:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 489us (699us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1787834233.586671:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:0.0:1787834233.589259:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834233.589675:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382054272 00000100:00100000:2.0:1787834233.589684:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382054272 00000100:00100000:3.0:1787834233.589799:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:3.0:1787834233.589813:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+38:18813:x1874679382054272:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787834233.589849:0:22706:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787834233.590135:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+38:18813:x1874679382054272:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 325us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834233.590143:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:1.0:1787834233.598080:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834233.598457:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382054528 00000100:00100000:2.0:1787834233.598467:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382054528 00000100:00100000:2.0:1787834233.598526:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:2.0:1787834233.598537:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+38:18813:x1874679382054528:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787834233.598557:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834233.598576:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1f4ea lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f292 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787834233.599056:0:22704:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1787834233.599063:0:22704:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1787834233.599090:0:22704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1787834233.599213:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f4f1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.599227:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f4f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.599237:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f4f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.599287:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc600/0x996d2fb20dc1f4ea lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f292 expref: 41 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.599306:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f4f1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f292 expref: 40 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.599314:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802f00) 00010000:00010000:2.0:1787834233.599316:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787834233.599320:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fda00, rc 0) 00000100:00100000:2.0:1787834233.599388:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+40:18813:x1874679382054528:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 853us (1315us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1787834233.599396:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:2.0:1787834233.602731:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.602905:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382054784 00000100:00100000:1.0:1787834233.602914:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382054784 00000100:00100000:1.0:1787834233.602970:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:1.0:1787834233.602978:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+40:18813:x1874679382054784:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787834233.603042:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834233.603218:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fda00/0x996d2fb20dc1f4f1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f292 expref: 40 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603236:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802f00) 00010000:00010000:1.0:1787834233.603245:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787834233.603268:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603298:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603307:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603321:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603328:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603334:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603372:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603379:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603386:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603393:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.603397:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603405:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603414:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:1.0:1787834233.603423:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834233.603427:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603434:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f4ff lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603445:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603451:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603457:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603462:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.603464:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603470:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603478:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xbb1b851e (ffff8df503f0ca00) 00010000:00010000:1.0:1787834233.603481:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834233.603484:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.603490:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f506 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xbb1b851e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834233.603614:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+39:18813:x1874679382054784:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 636us (891us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787834233.603629:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:0.0:1787834233.606334:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834233.606418:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382054912 00000100:00100000:2.0:1787834233.606427:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382054912 00000100:00100000:2.0:1787834233.606513:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:2.0:1787834233.606523:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df502ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+39:18813:x1874679382054912:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787834233.606542:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834233.606563:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f50d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f299 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.606618:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f514 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.606630:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f514 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.606641:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f514 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.606733:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fd200/0x996d2fb20dc1f50d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f299 expref: 41 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.606779:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df6013fc200/0x996d2fb20dc1f514 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f299 expref: 40 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.606788:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:2.0:1787834233.606791:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787834233.606794:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fc200, rc 0) 00000100:00100000:2.0:1787834233.606851:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df502ed12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+40:18813:x1874679382054912:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 330us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834233.606866:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1787834233.609149:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.609581:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382055168 00000100:00100000:0.0:1787834233.609590:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382055168 00000100:00100000:1.0:1787834233.609696:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:1.0:1787834233.609706:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+40:18813:x1874679382055168:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787834233.609804:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.609822:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.609833:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787834233.610090:0:23763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1787834233.610102:0:23763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709523350536ns, next at 710523347448ns, rc = 0 00000004:00010000:1.0:1787834233.610151:0:23763:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084a1fda4 reply state 00000000eb1012aa transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.610165:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.610172:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:1.0:1787834233.610175:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787834233.610179:0:23763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787834233.610267:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+42:18813:x1874679382055168:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 562us (1125us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1787834233.610275:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:3.0:1787834233.612655:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.613368:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382055296 00000100:00100000:1.0:1787834233.613390:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382055296 00000100:00100000:1.0:1787834233.613454:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:1.0:1787834233.613464:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+42:18813:x1874679382055296:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787834233.613490:0:23763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834233.613527:0:23763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f2a0 expref: -99 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.613607:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a0 expref: 43 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.613622:0:23763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a0 expref: 43 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.613641:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:1.0:1787834233.613644:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787834233.613648:0:23763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031a00, rc 0) 00000100:00100000:1.0:1787834233.613716:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+43:18813:x1874679382055296:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 254us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834233.613723:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:0.0:1787834233.622448:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834233.622618:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382055424 00000100:00100000:2.0:1787834233.622628:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382055424 00000100:00100000:2.0:1787834233.622687:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1787834233.622697:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+5:2400:x1874679382055424:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787834233.623210:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2400:x1874679382055424:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 512us (769us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787834233.623235:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1787834233.632479:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.632567:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382055680 00000100:00100000:0.0:1787834233.632586:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382055680 00000100:00100000:0.0:1787834233.632645:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:0.0:1787834233.632656:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+43:18813:x1874679382055680:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787834233.633402:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+44:18813:x1874679382055680:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 746us (930us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1787834233.633424:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:2.0:1787834233.636664:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.637003:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382055936 00000100:00100000:0.0:1787834233.637020:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382055936 00000100:00100000:1.0:1787834233.637237:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:1.0:1787834233.637248:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+44:18813:x1874679382055936:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787834233.637393:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+44:18813:x1874679382055936:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 147us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834233.637402:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:2.0:1787834233.640167:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.640600:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382056064 00000100:00100000:1.0:1787834233.640610:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382056064 00000100:00100000:1.0:1787834233.640684:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:1.0:1787834233.640694:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+44:18813:x1874679382056064:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787834233.640716:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834233.640736:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f529 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f2a7 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.641162:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f530 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.641178:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f530 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.641189:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f530 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787834233.641233:0:22704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787834233.641252:0:22704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f530 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.641279:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031000/0x996d2fb20dc1f529 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a7 expref: 46 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.641298:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f530 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a7 expref: 45 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.641308:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:1.0:1787834233.641310:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787834233.641313:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600030800, rc 0) 00000100:00100000:1.0:1787834233.641366:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+45:18813:x1874679382056064:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 674us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834233.641384:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:2.0:1787834233.644511:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.644601:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382056192 00000100:00100000:1.0:1787834233.644610:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382056192 00000100:00100000:1.0:1787834233.644689:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:1.0:1787834233.644699:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+6:2401:x1874679382056192:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787834233.644717:0:24845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834233.644736:0:24845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f2ae expref: -99 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787834233.644791:0:24845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902f79, blocks: 0x0 00010000:00010000:1.0:1787834233.644810:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1787834233.644814:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787834233.644824:0:24845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ae expref: 7 pid: 24845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.645053:0:24845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ae expref: 7 pid: 24845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.645068:0:24845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031c00, rc 0) 00000100:00100000:1.0:1787834233.645135:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:2401:x1874679382056192:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 436us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834233.645142:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:2.0:1787834233.648617:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834233.648689:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382056448 00000100:00100000:3.0:1787834233.648697:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382056448 00000100:00100000:0.0:1787834233.649096:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:0.0:1787834233.649110:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+45:18813:x1874679382056448:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787834233.649222:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+45:18813:x1874679382056448:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 116us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834233.649230:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:0.0:1787834233.668933:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.669289:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382056576 00000100:00100000:1.0:1787834233.669299:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382056576 00000100:00100000:1.0:1787834233.669362:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:1.0:1787834233.669373:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+45:18813:x1874679382056576:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787834233.674145:0:22685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1787834233.674169:0:22685:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787834233.674240:0:22685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1787834233.677306:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.677324:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.677331:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.677338:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df611a4ea00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.677342:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.677350:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.677368:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:1.0:1787834233.677372:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787834233.677377:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.677383:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df611a4ea00/0x996d2fb20dc1f307 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834233.677546:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+20:18813:x1874679382056576:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 8171us (8617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834233.677557:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:0.0:1787834233.678455:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787834233.678504:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406270976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787834233.678576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834233.680632:0:25150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406270976 00000100:00100000:1.0:1787834233.680645:0:25150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406270976 00000100:00100000:1.0:1787834233.680706:0:25150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787834233.680715:0:25150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1874679406270976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787834233.680894:0:25150:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787834233.680898:0:25150:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787834233.680901:0:25150:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787834233.680903:0:25150:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787834233 -> 1787834233 00002000:00010000:1.0:1787834233.680905:0:25150:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787834233.681419:0:25150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1874679406270976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 704us (2841us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787834233.681427:0:25150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1787834233.682204:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8df5045aa580/2, rc 0, transno 12884901892 00000100:00100000:2.0:1787834233.682213:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874679406270976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787834233.692556:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:1.0:1787834233.693294:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693308:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693316:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693322:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.693327:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693335:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693351:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8df606324700) 00010000:00010000:1.0:1787834233.693355:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834233.693360:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693366:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722c00/0x996d2fb20dc1f2b3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693407:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693414:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693420:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693425:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723200 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.693428:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693434:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693442:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:1.0:1787834233.693444:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834233.693447:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693452:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723200/0x996d2fb20dc1f2ba lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693514:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693521:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693527:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693539:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.693542:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693548:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693556:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8df606324d00) 00010000:00010000:1.0:1787834233.693558:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834233.693561:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693566:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723e00/0x996d2fb20dc1f370 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693584:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693591:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693597:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693602:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.693605:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693610:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693629:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834233.693631:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834233.693635:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693640:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723400/0x996d2fb20dc1f42d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693653:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693659:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693665:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693670:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.693672:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693678:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693685:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834233.693687:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834233.693690:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693695:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247c00/0x996d2fb20dc1f450 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693717:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693723:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693728:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693733:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031800 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.693736:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693742:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693795:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834233.693798:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834233.693801:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693808:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f496 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693822:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693827:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693833:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693843:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600030e00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.693846:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693852:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693872:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:1.0:1787834233.693874:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787834233.693877:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.693883:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030e00/0x996d2fb20dc1f51b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834233.695218:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382056704 00000100:00100000:0.0:1787834233.695231:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382056704 00000100:00100000:0.0:1787834233.695314:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:0.0:1787834233.695326:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df634c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:2400:x1874679382056704:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787834233.695440:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df634c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:2400:x1874679382056704:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 117us (2892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834233.695447:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:2.0:1787834233.707634:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.708207:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382056960 00000100:00100000:0.0:1787834233.708217:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382056960 00000100:00100000:0.0:1787834233.708279:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:0.0:1787834233.708290:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+14:18813:x1874679382056960:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787834233.708342:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834233.708380:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600030800/0x996d2fb20dc1f530 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a7 expref: 14 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.708401:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:0.0:1787834233.708407:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787834233.708438:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f53e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.708451:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f53e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.708461:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f53e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787834233.708582:0:22706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f702507d reply state 000000007d19e941 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f53e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.708596:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246800/0x996d2fb20dc1f53e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.708602:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:0.0:1787834233.708605:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787834233.708608:0:22706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787834233.708704:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+15:18813:x1874679382056960:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 415us (1079us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1787834233.708712:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:1.0:1787834233.711651:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834233.712420:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382057088 00000100:00100000:2.0:1787834233.712431:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382057088 00000100:00100000:2.0:1787834233.712489:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1787834233.712500:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:18813:x1874679382057088:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787834233.712517:0:24845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787834233.712536:0:24845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f2b5 expref: -99 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.712567:0:24845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ae expref: 8 pid: 24845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.712587:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834233.712590:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834233.712612:0:24845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 8 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.712660:0:24845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ae expref: 8 pid: 24845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.712675:0:24845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ae expref: 8 pid: 24845 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834233.712691:0:24845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a84c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24845:1874679406271104:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787834233.712954:0:24845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60eaca000 going to sleep for 11 seconds 00000100:00100000:2.0:1787834233.723077:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834233.725189:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382057216 00000100:00100000:3.0:1787834233.725203:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382057216 00010000:00010000:3.0:1787834233.725268:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ae expref: 9 pid: 24845 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834233.725324:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1787834233.725335:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:2401:x1874679382057216:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787834233.725352:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787834233.725372:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ae expref: 9 pid: 24845 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.725386:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ae expref: 9 pid: 24845 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.725427:0:22692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834233.725432:0:22692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787834233.725439:0:22692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 9 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.725449:0:22692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 9 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.725485:0:22692:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 9 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834233.725501:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5010a1a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22692:1874679406271232:192.168.203.17@tcp:105: 00000100:00100000:3.0:1787834233.725658:0:22692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df604dc0480 going to sleep for 11 seconds 00010000:00010000:1.0:1787834233.728934:0:24845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086cbbc79/0x996d2fb20dc1f537 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ae expref: 9 pid: 24845 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834233.728964:0:24845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a84c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24845:1874679406271104:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787834233.728994:0:24845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 8 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.729038:0:24845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df6013fc600, rc 0) 00000100:00100000:2.0:1787834233.732539:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+8:18813:x1874679382057088:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 20030us (20886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834233.732553:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1787834233.745907:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5010a1a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22692:1874679406271232:192.168.203.17@tcp:105: 00010000:00010000:3.0:1787834233.745935:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787834233.745989:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:2401:x1874679382057216:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 20654us (22919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834233.746000:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1787834233.746830:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.747034:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382057344 00000100:00100000:1.0:1787834233.747043:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382057344 00000100:00100000:1.0:1787834233.747098:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:1.0:1787834233.747109:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:2401:x1874679382057344:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787834233.747306:0:24208:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787834233.747310:0:24208:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787834233 00002000:00010000:1.0:1787834233.747312:0:24208:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787834231 00002000:00010000:1.0:1787834233.747314:0:24208:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787834233 -> 1787834233 00002000:00010000:1.0:1787834233.747327:0:24208:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787834233.747385:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+8:2401:x1874679382057344:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 277us (558us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787834233.747391:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:0.0:1787834233.749586:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834233.749687:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382057472 00000100:00100000:2.0:1787834233.749698:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382057472 00000100:00100000:2.0:1787834233.749788:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:2.0:1787834233.749798:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+8:2398:x1874679382057472:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787834233.749840:0:24210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.749860:0:24210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 8 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.749869:0:24210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787834233.749888:0:24210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787834233.749893:0:24210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.749929:0:24210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 8 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787834233.749941:0:24210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 8 pid: 24845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834233.749954:0:24210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a84c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24210:1874679406271360:192.168.203.17@tcp:104: 00000100:00100000:2.0:1787834233.750040:0:24210:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60eacab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787834233.758567:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.758684:0:24210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a84c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24210:1874679406271360:192.168.203.17@tcp:104: 00010000:00010000:1.0:1787834233.758721:0:24210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834233.759107:0:23458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382057600 00000100:00100000:0.0:1787834233.759113:0:23458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382057600 00010000:00010000:0.0:1787834233.759147:0:23458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 9 pid: 24845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834233.759204:0:23458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1787834233.759213:0:23458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+9:2400:x1874679382057600:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834233.759227:0:23458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834233.759247:0:23458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 9 pid: 24845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.759260:0:23458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 9 pid: 24845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.759282:0:23458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c29a2fa5/0x996d2fb20dc1f545 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2b5 expref: 9 pid: 24845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.759299:0:23458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787834233.759303:0:23458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787834233.759309:0:23458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.759319:0:23458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.759346:0:23458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787834233.759402:0:24210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834233.759402:0:23458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+8:2400:x1874679382057600:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 190us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834233.759410:0:23458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00010000:00010000:1.0:1787834233.759411:0:24210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.759436:0:24210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.759444:0:24210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.759452:0:24210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.759466:0:24210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df6013fdc00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:1.0:1787834233.759470:0:24210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.759479:0:24210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.759492:0:24210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.759500:0:24210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f09ab0/0x996d2fb20dc1f54c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834233.759548:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:2398:x1874679382057472:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 9752us (9984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834233.759556:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:3.0:1787834233.762253:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.762332:0:23763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382057856 00000100:00100000:0.0:1787834233.762340:0:23763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382057856 00000100:00100000:0.0:1787834233.762398:0:23763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:0.0:1787834233.762408:0:23763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+15:18813:x1874679382057856:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787834233.762482:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.762498:0:23763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f253 expref: 15 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.762508:0:23763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.762538:0:23763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f253 expref: 15 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.762552:0:23763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f253 expref: 15 pid: 22706 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834233.762565:0:23763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23763:1874679406271488:192.168.203.17@tcp:104: 00000100:00100000:0.0:1787834233.762648:0:23763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787834233.779982:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.780062:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382057984 00000100:00100000:1.0:1787834233.780070:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382057984 00010000:00010000:1.0:1787834233.780110:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f253 expref: 16 pid: 22706 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834233.780153:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:1.0:1787834233.780164:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+16:2400:x1874679382057984:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787834233.780178:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787834233.780199:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f253 expref: 16 pid: 22706 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.780212:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f253 expref: 16 pid: 22706 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.780234:0:22690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834233.780250:0:22690:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f4b9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f284 expref: 16 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.780261:0:22690:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.780269:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.780276:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.780296:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787834233.780338:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722a00/0x996d2fb20dc1f426 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f253 expref: 16 pid: 22706 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834233.780365:0:23763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23763:1874679406271488:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787834233.780385:0:23763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.780405:0:23763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.780411:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.780593:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.780605:0:23763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a0 expref: 16 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.780612:0:23763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.780639:0:23763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a0 expref: 16 pid: 23763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.780652:0:23763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a0 expref: 16 pid: 23763 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834233.780665:0:23763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23763:1874679406271616:192.168.203.17@tcp:104: 00000100:00100000:1.0:1787834233.786573:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+16:2400:x1874679382057984:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 6398us (6586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834233.786588:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:0.0:1787834233.788767:0:23763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df50382e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787834233.791061:0:23763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23763:1874679406271616:192.168.203.17@tcp:104: 00010000:00010000:0.0:1787834233.791089:0:23763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787834233.791520:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.791590:0:23458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382058112 00000100:00100000:0.0:1787834233.791666:0:23458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382058112 00010000:00010000:0.0:1787834233.791703:0:23458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a0 expref: 16 pid: 23763 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834233.791782:0:23458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:0.0:1787834233.791793:0:23458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5047c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+16:2400:x1874679382058112:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787834233.791808:0:23458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787834233.791814:0:23458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a0 expref: 16 pid: 23763 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.791826:0:23458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a0 expref: 16 pid: 23763 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.791849:0:23458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031a00/0x996d2fb20dc1f522 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2a0 expref: 16 pid: 23763 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.791864:0:23458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:0.0:1787834233.791870:0:23458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.791878:0:23458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.791886:0:23458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.791907:0:23458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787834233.791956:0:23458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5047c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+15:2400:x1874679382058112:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 165us (438us total) trans 0 rc 0/0 00010000:00010000:1.0:1787834233.791958:0:23763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.791965:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787834233.791974:0:23458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000001:00080000:1.0:1787834233.792091:0:23763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:1.0:1787834233.792218:0:23763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:1.0:1787834233.792260:0:23763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:1.0:1787834233.792333:0:23763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6376d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23763:1874679406271744:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787834233.792377:0:23763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834233.793078:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406271744 00000100:00100000:2.0:1787834233.793084:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406271744 00000100:00100000:1.0:1787834233.793097:0:23763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df612c27d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787834233.793161:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787834233.793170:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23763:x1874679406271744:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787834233.793263:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23763:x1874679406271744:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834233.793269:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787834233.793330:0:23763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6376d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23763:1874679406271744:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787834233.793476:0:23763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1787834233.793524:0:23763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6376d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23763:1874679406271872:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787834233.793566:0:23763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787834233.793727:0:23763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df60e181180 going to sleep for 11 seconds 00000100:00100000:0.0:1787834233.794439:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406271872 00000100:00100000:0.0:1787834233.794446:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406271872 00000100:00100000:0.0:1787834233.794483:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787834233.794490:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23763:x1874679406271872:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787834233.795148:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:23763:x1874679406271872:12345-0@lo:1000:mdt00_003.0 Request processed in 657us (1580us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1787834233.795156:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787834233.795424:0:23763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6376d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23763:1874679406271872:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787834233.795472:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795482:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795488:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795494:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246600 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.795499:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795507:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795522:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:1.0:1787834233.795525:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787834233.795539:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795546:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246600/0x996d2fb20dc1f55a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795579:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795586:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795592:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795597:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b247400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.795599:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795604:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795612:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834233.795615:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787834233.795623:0:23763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f4b9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f284 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795634:0:23763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f4b9 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f284 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795836:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f4b9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f284 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.795907:0:23763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722800/0x996d2fb20dc1f4b9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f284 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834233.795921:0:23763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df6376d52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23763:1874679406272000:192.168.203.17@tcp:105: 00000100:00100000:1.0:1787834233.796045:0:23763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8df503dbe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787834233.799157:0:23763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df6376d52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23763:1874679406272000:192.168.203.17@tcp:105: 00010000:00010000:1.0:1787834233.799187:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799198:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247400/0x996d2fb20dc1f4b2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799229:0:23763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799242:0:23763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799254:0:23763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799263:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799269:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799276:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799298:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.799302:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799309:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799320:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834233.799323:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787834233.799327:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799333:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f561 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799345:0:23763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799351:0:23763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799357:0:23763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799362:0:23763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df63b246c00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:1.0:1787834233.799365:0:23763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799371:0:23763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799390:0:23763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:1.0:1787834233.799392:0:23763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787834233.799395:0:23763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.799401:0:23763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f553 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787834233.799564:0:23763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5010a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+18:18813:x1874679382057856:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 37156us (37317us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1787834233.799574:0:23763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00000020:00080000:1.0:1787834233.799580:0:23763:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787834233.799986:0:22740:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787834233.799992:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787834233.800023:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787834233.800031:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787834233.810411:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1787834233.810452:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.810527:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382058368 00000100:00100000:1.0:1787834233.810546:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382058368 00000100:00100000:1.0:1787834233.810593:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382058496 00000100:00100000:1.0:1787834233.810597:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382058496 00000100:00100000:1.0:1787834233.810614:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:1.0:1787834233.810623:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+19:18813:x1874679382058368:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787834233.810927:0:22707:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787834233.810960:0:22707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1787834233.810995:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.811021:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.811033:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.811317:0:22707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.811325:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.811331:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.811353:0:22707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787834233.811448:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+21:18813:x1874679382058368:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 825us (1045us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1787834233.811457:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000020:00080000:1.0:1787834233.811462:0:22707:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787834233.811481:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:1.0:1787834233.811490:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+20:18811:x1874679382058496:12345-192.168.203.17@tcp:49:bash.0 00000100:00100000:1.0:1787834233.811548:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+20:18811:x1874679382058496:12345-192.168.203.17@tcp:49:bash.0 Request processed in 60us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787834233.811556:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00010000:00010000:3.0:1787834233.811735:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787834233.811742:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.811772:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df600031c00 already unused, calling callback (ffffffffc0c00500) 00010000:00010000:3.0:1787834233.811776:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.811784:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.811798:0:22694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8df634802500) 00010000:00010000:3.0:1787834233.811801:0:22694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787834233.811805:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.811810:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031c00/0x996d2fb20dc1f568 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.811825:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834233.811827:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834233.811828:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834233.815445:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.815527:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382058624 00000100:00100000:0.0:1787834233.815547:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382058624 00000100:00100000:0.0:1787834233.815607:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:0.0:1787834233.815617:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+7:18811:x1874679382058624:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1787834233.815635:0:24845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834233.815655:0:24845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f56f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f2bc expref: -99 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787834233.815681:0:24845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a902f79, atime: 0x6a902f77, ctime: 0x6a902f79, blocks: 0x0 00010000:00010000:0.0:1787834233.815702:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1787834233.815707:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787834233.815717:0:24845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f56f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2bc expref: 8 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.815733:0:24845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000428b0f1f/0x996d2fb20dc1f56f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2bc expref: 8 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.815745:0:24845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246400, rc 0) 00000100:00100000:0.0:1787834233.815842:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+8:18811:x1874679382058624:12345-192.168.203.17@tcp:101:bash.0 Request processed in 226us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834233.815849:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1787834233.821782:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.822448:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382058752 00000100:00100000:0.0:1787834233.822459:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382058752 00000100:00100000:0.0:1787834233.822523:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:0.0:1787834233.822541:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+20:18811:x1874679382058752:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1787834233.822565:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787834233.822586:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247000/0x996d2fb20dc1f576 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f2c3 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.822622:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f57d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.822635:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f57d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.822645:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f57d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.822797:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b247000/0x996d2fb20dc1f576 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2c3 expref: 22 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.822816:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df63b246c00/0x996d2fb20dc1f57d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2c3 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787834233.822824:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:0.0:1787834233.822827:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787834233.822831:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df63b246c00, rc 0) 00000100:00100000:0.0:1787834233.822903:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+21:18811:x1874679382058752:12345-192.168.203.17@tcp:101:bash.0 Request processed in 372us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834233.822910:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:1.0:1787834233.827261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.827667:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382059008 00000100:00100000:0.0:1787834233.827676:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382059008 00000100:00100000:0.0:1787834233.827730:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:0.0:1787834233.827740:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df6376d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+21:18811:x1874679382059008:12345-192.168.203.17@tcp:35:bash.0 00000001:00080000:0.0:1787834233.827975:0:22708:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:0.0:1787834233.828070:0:22708:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:0.0:1787834233.828177:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df6376d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+24:18811:x1874679382059008:12345-192.168.203.17@tcp:35:bash.0 Request processed in 438us (925us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1787834233.828186:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000020:00080000:0.0:1787834233.828192:0:22708:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787834233.923602:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1787834233.923707:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382059264 00000100:00100000:1.0:1787834233.923717:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382059264 00000100:00100000:1.0:1787834233.923804:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:1.0:1787834233.923814:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+24:18823:x1874679382059264:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1787834233.923837:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787834233.923857:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x79fe69990d91f2ca expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787834233.924098:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787834233.924188:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f584 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ca expref: 26 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.924202:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8df634802e00) 00010000:00010000:1.0:1787834233.924205:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787834233.924210:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df600031800/0x996d2fb20dc1f584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0x79fe69990d91f2ca expref: 26 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787834233.924224:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8df600031800, rc 0) 00000100:00100000:1.0:1787834233.924286:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+25:18823:x1874679382059264:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 473us (692us total) trans 12884901930 rc 301/301 00000100:00100000:1.0:1787834233.924293:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:2.0:1787834233.927869:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1787834233.927993:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382059392 00000100:00100000:3.0:1787834233.928003:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382059392 00000100:00100000:3.0:1787834233.928078:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:3.0:1787834233.928088:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+25:18823:x1874679382059392:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:3.0:1787834233.928328:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928345:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928374:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928390:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928397:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928403:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928469:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928478:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928484:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787834233.928529:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928543:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928549:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928556:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928571:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723a00 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834233.928576:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928583:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928595:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8df606324500) 00010000:00010000:3.0:1787834233.928598:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834233.928602:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928609:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723a00/0x996d2fb20dc1f592 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928632:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928639:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928644:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928649:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620722400 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834233.928652:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928658:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928675:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8df606324200) 00010000:00010000:3.0:1787834233.928677:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834233.928680:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928686:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620722400/0x996d2fb20dc1f599 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928707:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928713:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928718:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928724:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8df620723000 already unused, calling callback (ffffffffc18414f0) 00010000:00010000:3.0:1787834233.928726:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928732:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928739:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8df606324400) 00010000:00010000:3.0:1787834233.928741:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787834233.928744:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787834233.928790:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8df620723000/0x996d2fb20dc1f5a0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787834233.928884:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+25:18823:x1874679382059392:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 797us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787834233.928893:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:2.0:1787834233.937003:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1787834233.949384:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679382059648 00000100:00100000:0.0:1787834233.949418:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679382059648 00000100:00100000:0.0:1787834233.949491:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:0.0:1787834233.949502:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+25:18823:x1874679382059648:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1787834233.950406:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a9783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eda90af-ee5e-43ad-9f5e-133e0c7073b5+26:18823:x1874679382059648:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 901us (13408us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1787834233.950416:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00010000:00010000:3.0:1787834234.010432:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787834235.030108:0:24235:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787834235.221088:0:25787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1787834236.055350:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787834236.760230:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406272128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787834236.760327:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834236.760816:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787834236.760829:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a979a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406272256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787834236.760864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834236.760899:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406272256 00000100:00100000:2.0:1787834236.760906:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406272256 00000100:00100000:2.0:1787834236.760971:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787834236.760981:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406272256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787834236.761027:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787834236.761076:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a97a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874679406272256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834236.761084:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787834236.761137:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a979a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874679406272256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787834236.761269:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406272128 00000100:00100000:0.0:1787834236.761275:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406272128 00000100:00100000:0.0:1787834236.761341:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787834236.761349:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df63a978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406272128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787834236.761376:0:24213:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787834236.761417:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df63a978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874679406272128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787834236.761423:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787834236.761498:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787834236.761578:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df5045a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874679406272128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787834236.768589:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8df63a979a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406272384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787834236.768680:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787834236.768823:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679406272384 00000100:00100000:2.0:1787834236.768832:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679406272384 00000100:00100000:2.0:1787834236.768888:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787834236.768898:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8df5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406272384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787834236.768943:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1787834236.769018:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8df5045a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874679406272384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787834236.769026:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787834236.769089:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8df63a979a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874679406272384:0@lo:41:osp-pre-0-1.0 Debug log: 13984 lines, 13984 kept, 0 dropped, 0 bad.